00000001:02000400:3.0F:1782528978.553767:0:2969:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1782528986.784779:0:3171:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1782528987.760027:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1315 MB/s 00000001:01000000:2.0:1782528988.010075:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1647 MB/s 00000001:01000000:2.0:1782528988.262462:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10839 MB/s 00000020:02000000:3.0:1782528988.547960:0:3263:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_99_gde77dd7 00000400:02000000:2.0:1782528989.902585:0:3278:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.202.150@tcp [8/256/0/180] 00008000:02000000:3.0:1782528994.368270:0:3428:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1782529046.455322:0:5235:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782529055.054829:0:5774:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782529055.054868:0:5774:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1782529055.056287:0:5774:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000006aea3e22 00000080:02000400:2.0:1782529055.056308:0:5774:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1782529055.062052:0:5774:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1782529055.062067:0:5774:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782529055.062289:0:5774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006fb0cd8d) 00000020:00000080:3.0:1782529055.062312:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782529055.084417:0:5774:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1782529055.084877:0:5774:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1782529055.128288:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782529055.128345:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782529055.128370:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782529055.128423:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782529055.128443:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782529055.128812:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782529055.128820:0:5774:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782529055.128854:0:5774:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eab806 00000020:01000004:2.0:1782529055.128863:0:5774:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782529055.129092:0:5774:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782529055.129099:0:5774:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006aea3e22 from MGS 00000020:01000004:2.0:1782529055.129105:0:5774:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782529055.129196:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000cb9bdbf3) 00000020:00000080:2.0:1782529055.129209:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782529055.129323:0:5774:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006aea3e22 from MGS, refs=2 00080000:01000000:2.0:1782529055.129339:0:5774:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782529055.129345:0:5774:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eab814 00000100:00100000:2.0:1782529055.129441:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782529055.129567:0:5774:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782529055.129579:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782529055.130552:0:5774:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782529055.130560:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782529055.134088:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782529055.134572:0:5774:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782529055.134579:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782529055.136201:0:5774:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782529055.136211:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782529055.137052:0:5774:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782529055.137062:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1782529055.138437:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529055.138441:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529055.138443:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529055.138765:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529055.138768:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529055.138770:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529055.139788:0:5774:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1782529055.146606:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1782529055.390713:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2211 MB/s 00000001:01000000:3.0:1782529055.639972:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3607 MB/s 00000001:01000000:2.0:1782529055.891195:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 681 MB/s 00000001:01000000:2.0:1782529056.141272:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 927 MB/s 00080000:10000000:1.0:1782529056.149173:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1782529056.162803:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1782529056.162821:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782529056.162824:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1782529056.165269:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1782529056.171557:0:5774:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1782529056.171630:0:5774:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1782529056.172677:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1782529056.172730:0:5774:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1782529056.173551:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529056.173717:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1782529056.173723:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1782529056.174567:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1782529056.174574:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1782529056.175239:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1782529056.175247:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1782529056.176235:0:5790:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1782529056.176298:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782529056.176332:0:5774:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.150@tcp' 00000020:01000004:1.0:1782529056.176334:0:5774:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782529056.176422:0:5774:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.150@tcp (typ=mgc) 00000020:00000080:1.0:1782529056.176453:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.150@tcp (0000000040ce48b2) 00000020:00000080:1.0:1782529056.176472:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782529056.176574:0:5774:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f9a6a0e9@MGC192.168.202.150@tcp: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1782529056.176724:0:5774:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.150@tcp-0 is initialized 00000040:01000000:1.0:1782529056.176731:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 1 is initialized 10000000:01000000:1.0:1782529056.181415:0:5791:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1782529056.181488:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.150@tcp (uuid adf301ee-99ae-4756-993e-d61f1989f0b8) 00000020:00000080:1.0:1782529056.181513:0:5774:0:(genops.c:1406:class_connect()) connect: client adf301ee-99ae-4756-993e-d61f1989f0b8, cookie 0x72bfdc08f7eab822 00000100:00080000:1.0:1782529056.181527:0:5774:0:(import.c:512:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782529056.181532:0:5774:0:(import.c:626:import_select_connection()) MGC192.168.202.150@tcp: import 00000000f9a6a0e9 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529056.181577:0:5774:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005f9d4904 x1869117117169792/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782529056.181656:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005f9d4904 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:adf301ee-99ae-4756-993e-d61f1989f0b8:3293:1869117117169792:0@lo:250: 00000100:00100000:1.0:1782529056.181753:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529056.181820:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117169792 00000100:00100000:1.0:1782529056.181827:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117169792 00000100:00100000:1.0:1782529056.181878:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782529056.181885:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a604cc13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3293:x1869117117169792:12345-0@lo:250: 00010000:00080000:1.0:1782529056.181906:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from adf301ee-99ae-4756-993e-d61f1989f0b8@0@lo t0 exp 0000000000000000 cur 118 last 0 00000020:00000080:1.0:1782529056.181930:0:5787:0:(genops.c:1406:class_connect()) connect: client adf301ee-99ae-4756-993e-d61f1989f0b8, cookie 0x72bfdc08f7eab829 00000100:00080000:1.0:1782529056.182826:0:5787:0:(import.c:65:import_set_state_nolock()) 000000009cc2ae18 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529056.182938:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a604cc13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+5:3293:x1869117117169792:12345-0@lo:250: Request processed in 1052us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529056.182948:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782529056.183288:0:5774:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import adf301ee-99ae-4756-993e-d61f1989f0b8->MGS 00000020:01000004:1.0:1782529056.183314:0:5774:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782529056.183349:0:5774:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782529056.183367:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000177df81d) 00000020:00000080:1.0:1782529056.183379:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782529056.184297:0:3293:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782529056.184308:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.150@tcp: connect to target with instance 0 00000100:00080000:2.0:1782529056.184314:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782529056.184318:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782529056.184333:0:3293:0:(import.c:65:import_set_state_nolock()) 00000000f9a6a0e9 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782529056.184337:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782529056.184348:0:3293:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782529056.184354:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005f9d4904 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:adf301ee-99ae-4756-993e-d61f1989f0b8:3293:1869117117169792:0@lo:250: 00010000:00010000:0.0:1782529056.199602:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529056.212548:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529056.212774:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782529056.212781:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1782529056.214590:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1782529056.214603:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1782529056.215395:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1782529056.215404:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1782529056.216567:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529056.216751:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1782529056.216757:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1782529056.217825:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1782529056.217934:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782529056.282367:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782529056.282720:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782529056.282727:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782529056.284783:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782529056.284796:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782529056.286062:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782529056.286340:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782529056.286346:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782529056.287364:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782529056.287373:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782529056.288424:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782529056.288743:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782529056.288757:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1782529056.292230:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782529056.292263:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782529056.293063:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529056.293400:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782529056.293409:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782529056.294198:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782529056.294206:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782529056.354306:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782529056.357063:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782529056.357074:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782529056.362616:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782529056.362632:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782529056.364217:0:5774:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782529056.364231:0:5774:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782529056.389612:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1782529056.389642:0:5774:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1782529056.389648:0:5774:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1782529056.389782:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782529056.389818:0:5774:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1782529056.389822:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782529056.389824:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529056.389825:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529056.389826:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529056.389827:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529056.389829:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529056.389864:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529056.389865:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529056.389866:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782529056.389868:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782529056.389869:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529056.389870:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782529056.389872:0:5774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1782529056.389874:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782529056.389876:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529056.389876:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529056.389877:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529056.389878:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529056.389880:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529056.389880:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529056.389881:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529056.389882:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782529056.389883:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782529056.389884:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529056.389885:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782529056.389922:0:5774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782529056.389940:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117169920:0@lo:253: 00000100:00100000:2.0:1782529056.390047:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529056.390230:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 0000000099372317 going to sleep for 11 seconds 00000100:00100000:3.0:1782529056.390315:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117169920 00000100:00100000:3.0:1782529056.390334:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117169920 00000100:00100000:3.0:1782529056.390375:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782529056.390383:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000097338407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+5:5774:x1869117117169920:12345-0@lo:253: 20000000:01000000:3.0:1782529056.390431:0:5789:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782529056.390434:0:5789:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1782529056.391980:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1782529056.392174:0:5789:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1782529056.392619:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782529056.394994:0:5811:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1782529056.407237:0:5789:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782529056.407244:0:5789:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1782529056.407251:0:5789:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1782529056.407255:0:5789:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1782529056.407273:0:5789:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1782529056.407573:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529056.407798:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1782529056.407814:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782529056.407888:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1782529056.407935:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1782529056.407973:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1782529056.408062:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1782529056.408071:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1782529056.408108:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1782529056.408116:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1782529056.408148:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1782529056.408156:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1782529056.408194:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1782529056.408239:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1782529056.408269:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782529056.408273:0:5789:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1782529056.408283:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529056.408501:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1782529056.408511:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782529056.408542:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1782529056.408574:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1782529056.408617:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1782529056.408629:0:5789:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1782529056.408698:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1782529056.408706:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782529056.408743:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1782529056.408775:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1782529056.408805:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1782529056.408815:0:5789:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1782529056.408920:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1782529056.408929:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1782529056.408962:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1782529056.408999:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1782529056.409148:0:5789:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1782529056.409194:0:5789:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1782529056.409202:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1782529056.417515:0:5812:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1782529056.418047:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1782529056.418080:0:5789:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.150@tcp for mdt 20000000:01000000:3.0:1782529056.418083:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:3.0:1782529056.418133:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1782529056.418141:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782529056.418173:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1782529056.418182:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:3.0:1782529056.418224:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1782529056.418242:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1782529056.418277:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1782529056.418338:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1782529056.418407:0:5789:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782529056.418411:0:5789:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782529056.418414:0:5789:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782529056.418436:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782529056.418439:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782529056.418715:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782529056.418717:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782529056.435257:0:5813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1782529056.436692:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1782529056.436741:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1782529056.436808:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1782529056.436821:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782529056.436823:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782529056.455981:0:5814:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1782529056.456414:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1782529056.456468:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1782529056.456508:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1782529056.456523:0:5789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782529056.456526:0:5789:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1782529056.456532:0:5789:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782529056.456535:0:5789:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782529056.456540:0:5789:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782529056.456548:0:5789:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1782529056.457317:0:5815:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1782529056.457513:0:5789:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1782529056.472755:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1782529056.472811:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1782529056.472959:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1782529056.472984:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782529056.473009:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473031:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473042:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473049:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473055:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473062:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473069:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006fc3b15d already unused, calling callback (000000006d44a138) 00010000:00010000:2.0:1782529056.473074:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473081:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473097:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473120:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.473126:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006fc3b15d/0x72bfdc08f7eab837 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782529056.473145:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1782529056.709442:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000097338407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+5:5774:x1869117117169920:12345-0@lo:253: Request processed in 319053us (319389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529056.709460:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529056.709619:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117169920:0@lo:253: 10000000:01000000:2.0:1782529056.709636:0:5774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782529056.709640:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782529056.709642:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529056.709643:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529056.709644:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1782529056.709646:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529056.709647:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529056.709648:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529056.709650:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529056.709651:0:5774:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782529056.709653:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529056.709654:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782529056.709681:0:5774:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006aea3e22 from lustre-MDT0000 10000000:01000000:2.0:1782529056.709721:0:5774:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1782529056.709724:0:5774:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782529056.709728:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99c6457b19c0 10000000:01000000:2.0:1782529056.709732:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782529056.709740:0:5774:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff99c6457b19c0 from 1 10000000:01000000:2.0:1782529056.709743:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782529056.709783:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000006fc3b15d/0x72bfdc08f7eab83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.709794:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000006fc3b15d/0x72bfdc08f7eab83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.709815:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000006fc3b15d/0x72bfdc08f7eab83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529056.710029:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170048:0@lo:101: 00000100:00100000:2.0:1782529056.710072:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529056.710213:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc871ce7 going to sleep for 11 seconds 00000100:00100000:3.0:1782529056.710260:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117170048 00000100:00100000:3.0:1782529056.710267:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117170048 00000100:00100000:3.0:1782529056.710313:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782529056.710332:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003b821db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+5:5774:x1869117117170048:12345-0@lo:101: 00010000:00010000:3.0:1782529056.710346:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529056.710361:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5a28882/0x72bfdc08f7eab845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab83e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.710388:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5a28882/0x72bfdc08f7eab845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.710398:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5a28882/0x72bfdc08f7eab845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.710420:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5a28882, rc 0) 00000100:00100000:3.0:1782529056.710503:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003b821db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+6:5774:x1869117117170048:12345-0@lo:101: Request processed in 173us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529056.710510:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529056.710625:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170048:0@lo:101: 00010000:00010000:2.0:1782529056.710639:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000006fc3b15d/0x72bfdc08f7eab83e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.710646:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000006fc3b15d/0x72bfdc08f7eab83e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529056.710690:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170176:0@lo:501: 00000100:00100000:2.0:1782529056.710727:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529056.710789:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc871ce7 going to sleep for 11 seconds 00000100:00100000:3.0:1782529056.711048:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117170176 00000100:00100000:3.0:1782529056.711053:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117170176 00000100:00100000:3.0:1782529056.711083:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782529056.711089:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005b0fded8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+6:5774:x1869117117170176:12345-0@lo:501: 00000100:00100000:3.0:1782529056.711362:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005b0fded8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+6:5774:x1869117117170176:12345-0@lo:501: Request processed in 273us (634us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782529056.711370:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782529056.711427:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170176:0@lo:501: 10000000:01000000:2.0:1782529056.711450:0:5774:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782529056.711468:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 000000006fc3b15d/0x72bfdc08f7eab83e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.711476:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 000000006fc3b15d/0x72bfdc08f7eab83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529056.711484:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99c646a6f800 10000000:01000000:2.0:1782529056.711488:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782529056.711619:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99c646a6f800 10000000:01000000:2.0:1782529056.711622:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1782529056.711625:0:5774:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff99c646a6f800 from 1 10000000:01000000:2.0:1782529056.711627:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1782529056.711648:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000002a7811a9/0x72bfdc08f7eab84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.711655:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000002a7811a9/0x72bfdc08f7eab84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.711663:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000002a7811a9/0x72bfdc08f7eab84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529056.711677:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170304:0@lo:101: 00000100:00100000:2.0:1782529056.711704:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529056.711825:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc871ce7 going to sleep for 11 seconds 00000100:00100000:3.0:1782529056.711887:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117170304 00000100:00100000:3.0:1782529056.711893:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117170304 00000100:00100000:3.0:1782529056.711992:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782529056.711998:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000dd9d5be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+6:5774:x1869117117170304:12345-0@lo:101: 00010000:00010000:3.0:1782529056.712006:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529056.712017:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b106aec1/0x72bfdc08f7eab853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab84c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.712035:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b106aec1/0x72bfdc08f7eab853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab84c expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.712043:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b106aec1/0x72bfdc08f7eab853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab84c expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.712050:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b106aec1, rc 0) 00000100:00100000:3.0:1782529056.712124:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000dd9d5be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+7:5774:x1869117117170304:12345-0@lo:101: Request processed in 126us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529056.712138:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782529056.712198:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170304:0@lo:101: 00010000:00010000:2.0:1782529056.712210:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000002a7811a9/0x72bfdc08f7eab84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.712216:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000002a7811a9/0x72bfdc08f7eab84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529056.712227:0:5774:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1782529056.712241:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 000000002a7811a9/0x72bfdc08f7eab84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.712248:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 000000002a7811a9/0x72bfdc08f7eab84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529056.712265:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782529056.712268:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782529056.712272:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99c646a6f800 10000000:01000000:2.0:1782529056.712275:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1782529056.712277:0:5774:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1782529056.712279:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782529056.712293:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000007fafb645/0x72bfdc08f7eab85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.712299:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000007fafb645/0x72bfdc08f7eab85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.712304:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000007fafb645/0x72bfdc08f7eab85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529056.712366:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170432:0@lo:101: 00000100:00100000:2.0:1782529056.712394:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529056.712419:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc871ce7 going to sleep for 11 seconds 00000100:00100000:3.0:1782529056.712470:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117170432 00000100:00100000:3.0:1782529056.712475:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117170432 00000100:00100000:3.0:1782529056.712509:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782529056.712515:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000098f21f23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+7:5774:x1869117117170432:12345-0@lo:101: 00010000:00010000:3.0:1782529056.712522:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529056.712528:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000894ce2f2/0x72bfdc08f7eab861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab85a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.712542:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000894ce2f2/0x72bfdc08f7eab861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.712549:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000894ce2f2/0x72bfdc08f7eab861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529056.712555:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000894ce2f2, rc 0) 00000100:00100000:3.0:1782529056.712584:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000098f21f23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+8:5774:x1869117117170432:12345-0@lo:101: Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529056.712588:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782529056.712695:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170432:0@lo:101: 00010000:00010000:2.0:1782529056.712704:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000007fafb645/0x72bfdc08f7eab85a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529056.712711:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000007fafb645/0x72bfdc08f7eab85a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529056.712743:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170560:0@lo:501: 00000100:00100000:2.0:1782529056.712759:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529056.712780:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc871ce7 going to sleep for 11 seconds 00000100:00100000:3.0:1782529056.712846:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117170560 00000100:00100000:3.0:1782529056.712849:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117170560 00000100:00100000:3.0:1782529056.712872:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782529056.712877:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000063566a6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+8:5774:x1869117117170560:12345-0@lo:501: 00000100:00100000:3.0:1782529056.713092:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000063566a6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+9:5774:x1869117117170560:12345-0@lo:501: Request processed in 216us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529056.713097:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782529056.713154:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b393c68b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170560:0@lo:501: 00000100:00100000:0.0:1782529056.713187:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170688:0@lo:503: 00000100:00100000:0.0:1782529056.713226:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529056.713247:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 0000000052043922 going to sleep for 11 seconds 00000100:00100000:2.0:1782529056.713302:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117170688 00000100:00100000:2.0:1782529056.713306:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117170688 00000100:00100000:2.0:1782529056.713335:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782529056.713340:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007ee88af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+9:5774:x1869117117170688:12345-0@lo:503: 00000100:00100000:2.0:1782529056.713480:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007ee88af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+9:5774:x1869117117170688:12345-0@lo:503: Request processed in 140us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529056.713484:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782529056.713567:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117170688:0@lo:503: 00000100:00100000:3.0:1782529056.714134:0:5817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c6a53fb7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:5817:1869117117170816:0@lo:502: 00000100:00100000:3.0:1782529056.714166:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529056.714190:0:5817:0:(client.c:2701:ptlrpc_set_wait()) set 0000000048def05b going to sleep for 11 seconds 00000100:00100000:2.0:1782529056.714231:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117170816 00000100:00100000:2.0:1782529056.714234:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117170816 00000100:00100000:2.0:1782529056.714258:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782529056.714263:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007c241036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+9:5817:x1869117117170816:12345-0@lo:502: 00000100:00100000:2.0:1782529056.714431:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007c241036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+9:5817:x1869117117170816:12345-0@lo:502: Request processed in 168us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529056.714436:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782529056.715234:0:5817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c6a53fb7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:5817:1869117117170816:0@lo:502: 00000020:01000000:1.0:1782529056.715271:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529056.715284:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529056.715287:0:5817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782529056.715292:0:5817:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782529056.715296:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782529056.715313:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007edaa7f9) 00000020:00000080:1.0:1782529056.715346:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782529056.715515:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782529056.715820:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782529056.715829:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eab86f 00000020:00000080:0.0:1782529056.717562:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782529056.717575:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529056.717581:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529056.717583:0:5817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782529056.717586:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529056.717592:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529056.717593:0:5817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782529056.717597:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782529056.717617:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a0c94321) 00000020:00000080:0.0:1782529056.717633:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782529056.717638:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782529056.717639:0:5817:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782529056.717694:0:5817:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782529056.717700:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782529056.717810:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006aea3e22 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782529056.717824:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000001206e79) 00000020:00000080:0.0:1782529056.717902:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782529056.717987:0:5817:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782529056.717996:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eab884 00000020:00000080:0.0:1782529056.718107:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782529056.718113:0:5817:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782529056.718117:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72bfdc08f7eab88b 00080000:01000000:0.0:1782529056.718123:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782529056.718126:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eab892 00080000:10000000:0.0:1782529056.718554:0:5817:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1782529056.718759:0:5817:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1782529056.723350:0:5817:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1782529056.790006:0:5817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1782529056.790378:0:5817:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1782529056.792723:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1782529056.793100:0:5817:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782529056.826653:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000af50a68e) 00000020:00000080:3.0:1782529056.826678:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782529056.826757:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782529056.826764:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eab8a0 00000020:00000080:2.0:1782529056.828277:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1782529056.831827:0:5817:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1782529056.880549:0:5817:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1782529056.925998:0:5817:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529056.961034:0:5817:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1782529057.008119:0:5817:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782529057.055225:0:5817:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1782529057.077765:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72bfdc08f7eab8a7 00000020:00000080:3.0:1782529057.078307:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1782529057.078328:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529057.078336:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529057.078338:0:5817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1782529057.078344:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529057.078348:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529057.078350:0:5817:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782529057.078353:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782529057.078354:0:5817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782529057.078357:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529057.078360:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529057.078361:0:5817:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1782529057.078363:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529057.078367:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529057.078368:0:5817:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1782529057.078373:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1782529057.078416:0:5817:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1782529057.078474:0:5817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fba861a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:5817:1869117117170944:0@lo:502: 00000100:00100000:3.0:1782529057.078560:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529057.078615:0:5817:0:(client.c:2701:ptlrpc_set_wait()) set 00000000daf94779 going to sleep for 11 seconds 00000100:00100000:1.0:1782529057.078718:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117170944 00000100:00100000:1.0:1782529057.078725:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117170944 00000100:00100000:1.0:1782529057.078774:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782529057.078783:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000432ffb5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+9:5817:x1869117117170944:12345-0@lo:502: 00000100:00100000:1.0:1782529057.079294:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000432ffb5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+9:5817:x1869117117170944:12345-0@lo:502: Request processed in 512us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529057.079304:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782529057.079465:0:5817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fba861a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:5817:1869117117170944:0@lo:502: 00000020:01000000:3.0:1782529057.079494:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529057.079504:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529057.079506:0:5817:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1782529057.079511:0:5817:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1782529057.079674:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1782529057.079694:0:5774:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782529057.079715:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 000000007fafb645/0x72bfdc08f7eab85a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.079737:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 000000007fafb645/0x72bfdc08f7eab85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529057.079744:0:5774:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff99c646a6f800 from 1 10000000:01000000:2.0:1782529057.079747:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782529057.079778:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.079785:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.079793:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529057.079807:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171072:0@lo:101: 00000100:00100000:2.0:1782529057.079876:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.079897:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000004d3da3c1 going to sleep for 11 seconds 00000100:00100000:3.0:1782529057.080026:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117171072 00000100:00100000:3.0:1782529057.080031:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117171072 00000100:00100000:3.0:1782529057.080067:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782529057.080074:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000681f33ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+9:5774:x1869117117171072:12345-0@lo:101: 00010000:00010000:3.0:1782529057.080083:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529057.080096:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab8ae expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.080119:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.080128:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.080135:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5e86784, rc 0) 00000100:00100000:3.0:1782529057.080165:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000681f33ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+10:5774:x1869117117171072:12345-0@lo:101: Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529057.080171:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782529057.080240:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171072:0@lo:101: 00010000:00010000:2.0:1782529057.080251:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.080259:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529057.080796:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171200:0@lo:256: 00000100:00100000:2.0:1782529057.081074:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.081175:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000004d3da3c1 going to sleep for 11 seconds 00000100:00100000:1.0:1782529057.081285:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117171200 00000100:00100000:1.0:1782529057.081290:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117171200 00000100:00100000:1.0:1782529057.081359:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782529057.081365:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000377a5c37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+10:5774:x1869117117171200:12345-0@lo:256: 20000000:01000000:1.0:1782529057.081382:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1782529057.081393:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1782529057.081469:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000377a5c37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+10:5774:x1869117117171200:12345-0@lo:256: Request processed in 105us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529057.081477:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782529057.081543:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171200:0@lo:256: 10000000:01000000:2.0:1782529057.082159:0:5774:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782529057.082178:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.082187:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529057.082195:0:5774:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c646a6f800 from 1 10000000:01000000:2.0:1782529057.082198:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782529057.082226:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.082233:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.082241:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529057.082256:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171328:0@lo:101: 00000100:00100000:2.0:1782529057.082288:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.082563:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000004d3da3c1 going to sleep for 11 seconds 00000100:00100000:3.0:1782529057.082634:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117171328 00000100:00100000:3.0:1782529057.082639:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117171328 00000100:00100000:3.0:1782529057.082672:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782529057.082678:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000849cae80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+10:5774:x1869117117171328:12345-0@lo:101: 00010000:00010000:3.0:1782529057.082689:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529057.082702:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab8bc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.082725:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.082745:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.082754:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001dc6f85, rc 0) 00000100:00100000:3.0:1782529057.082798:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000849cae80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5774:x1869117117171328:12345-0@lo:101: Request processed in 121us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529057.082804:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782529057.082906:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171328:0@lo:101: 00010000:00010000:2.0:1782529057.082918:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.082937:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529057.082997:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171456:0@lo:501: 00000100:00100000:2.0:1782529057.083023:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.083049:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000004d3da3c1 going to sleep for 11 seconds 00000100:00100000:3.0:1782529057.083142:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117171456 00000100:00100000:3.0:1782529057.083147:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117171456 00000100:00100000:3.0:1782529057.083163:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782529057.083168:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000fe202cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5774:x1869117117171456:12345-0@lo:501: 00000100:00100000:3.0:1782529057.083701:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000fe202cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5774:x1869117117171456:12345-0@lo:501: Request processed in 532us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529057.083710:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782529057.083822:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171456:0@lo:501: 00000100:00100000:2.0:1782529057.083886:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171584:0@lo:503: 00000100:00100000:2.0:1782529057.084038:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.084059:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000004d3da3c1 going to sleep for 11 seconds 00000100:00100000:3.0:1782529057.084106:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117171584 00000100:00100000:3.0:1782529057.084111:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117171584 00000100:00100000:3.0:1782529057.084131:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782529057.084136:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ff3fded1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5774:x1869117117171584:12345-0@lo:503: 00000040:00080000:3.0:1782529057.084173:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782529057.084219:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ff3fded1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5774:x1869117117171584:12345-0@lo:503: Request processed in 83us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529057.084225:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782529057.084293:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171584:0@lo:503: 00000040:00080000:2.0:1782529057.085178:0:5821:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1782529057.085536:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1782529057.085554:0:5774:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782529057.085609:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.085637:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529057.085679:0:5774:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782529057.085682:0:5774:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99c646a6f800 10000000:01000000:3.0:1782529057.085686:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99c646a6f800 10000000:01000000:3.0:1782529057.085690:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782529057.085697:0:5774:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c646a6f800 from 1 10000000:01000000:3.0:1782529057.085700:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782529057.085741:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000771ac143/0x72bfdc08f7eab8ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.085749:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000771ac143/0x72bfdc08f7eab8ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529057.085759:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000771ac143/0x72bfdc08f7eab8ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529057.085779:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fba861a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171712:0@lo:101: 00000100:00100000:3.0:1782529057.085829:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.088279:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117171712 00000100:00100000:2.0:1782529057.088290:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117171712 00000100:00100000:2.0:1782529057.088372:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529057.088381:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000103c2644 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5774:x1869117117171712:12345-0@lo:101: 00010000:00010000:2.0:1782529057.088399:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529057.088419:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b2bdb8d/0x72bfdc08f7eab8d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab8ca expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.088448:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b2bdb8d/0x72bfdc08f7eab8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.088461:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b2bdb8d/0x72bfdc08f7eab8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.088470:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b2bdb8d, rc 0) 00000100:00100000:2.0:1782529057.088529:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000103c2644 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5774:x1869117117171712:12345-0@lo:101: Request processed in 149us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529057.088552:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529057.088602:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000001b84c9e6 going to sleep for 11 seconds 00000100:00100000:2.0:1782529057.088625:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fba861a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171712:0@lo:101: 00010000:00010000:2.0:1782529057.088640:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000771ac143/0x72bfdc08f7eab8ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.088649:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000771ac143/0x72bfdc08f7eab8ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529057.088718:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171840:0@lo:501: 00000100:00100000:2.0:1782529057.088748:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.088763:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000000f445739 going to sleep for 11 seconds 00000100:00100000:3.0:1782529057.088812:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117171840 00000100:00100000:3.0:1782529057.088816:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117171840 00000100:00100000:3.0:1782529057.088866:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782529057.088873:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ebd2c637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5774:x1869117117171840:12345-0@lo:501: 00000100:00100000:3.0:1782529057.089354:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ebd2c637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5774:x1869117117171840:12345-0@lo:501: Request processed in 481us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529057.089361:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782529057.089531:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171840:0@lo:501: 00000100:00100000:2.0:1782529057.089563:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171968:0@lo:503: 00000100:00100000:2.0:1782529057.089600:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.089660:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000000f445739 going to sleep for 11 seconds 00000100:00100000:3.0:1782529057.089694:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117171968 00000100:00100000:3.0:1782529057.089705:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117171968 00000100:00100000:3.0:1782529057.089738:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782529057.089744:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000279fc5a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5774:x1869117117171968:12345-0@lo:503: 00000100:00100000:3.0:1782529057.090260:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000279fc5a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5774:x1869117117171968:12345-0@lo:503: Request processed in 516us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529057.090268:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782529057.090407:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000029af129b pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117171968:0@lo:503: 00000100:00100000:2.0:1782529057.090731:0:5822:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000098270f52 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:5822:1869117117172096:0@lo:502: 00000100:00100000:2.0:1782529057.090770:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.091016:0:5822:0:(client.c:2701:ptlrpc_set_wait()) set 0000000078aa4333 going to sleep for 11 seconds 00000100:00100000:1.0:1782529057.091060:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117172096 00000100:00100000:1.0:1782529057.091066:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117172096 00000100:00100000:1.0:1782529057.091133:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782529057.091139:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000006e4d2084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5822:x1869117117172096:12345-0@lo:502: 00000100:00100000:1.0:1782529057.091378:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000006e4d2084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5822:x1869117117172096:12345-0@lo:502: Request processed in 239us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529057.091385:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782529057.091448:0:5822:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000098270f52 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:5822:1869117117172096:0@lo:502: 00000020:01000004:2.0:1782529057.091511:0:5822:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1782529057.091527:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006a1d3652) 00000020:00000080:2.0:1782529057.091546:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1782529057.091715:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006aea3e22 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782529057.091719:0:5822:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006aea3e22 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782529057.091722:0:5822:0:(obd_mount.c:701:lustre_put_lsi()) put 000000006aea3e22 4 00010000:00080000:2.0:1782529057.091770:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b625acf5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1782529057.093440:0:5822:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1782529057.093537:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1782529057.093575:0:5822:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782529057.093599:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72bfdc08f7eab8df 00000100:00080000:2.0:1782529057.093610:0:5822:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782529057.093616:0:5822:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b625acf5 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1782529057.093656:0:5822:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000098270f52 x1869117117172224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782529057.093706:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000098270f52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117172224:0@lo:38: 00000100:00100000:2.0:1782529057.093775:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.093885:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117172224 00000100:00100000:2.0:1782529057.093892:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117172224 00000100:00100000:2.0:1782529057.093924:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529057.093930:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003848789d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3293:x1869117117172224:12345-0@lo:38: 00000100:00100000:2.0:1782529057.093992:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003848789d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3293:x1869117117172224:12345-0@lo:38: Request processed in 61us (217us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782529057.094000:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529057.094034:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782529057.094042:0:3293:0:(import.c:65:import_set_state_nolock()) 00000000b625acf5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782529057.094056:0:3293:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782529057.094059:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000098270f52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117172224:0@lo:38: 00000100:00080000:2.0:1782529057.094091:0:5822:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782529057.099223:0:5822:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d974de8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:5822:1869117117172352:0@lo:502: 00000100:00100000:3.0:1782529057.099310:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529057.099362:0:5822:0:(client.c:2701:ptlrpc_set_wait()) set 00000000582b70ad going to sleep for 11 seconds 00000100:00100000:2.0:1782529057.099522:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117172352 00000100:00100000:2.0:1782529057.099529:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117172352 00000100:00100000:2.0:1782529057.099580:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782529057.099588:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000085594860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5822:x1869117117172352:12345-0@lo:502: 00000100:00100000:2.0:1782529057.099872:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000085594860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5822:x1869117117172352:12345-0@lo:502: Request processed in 283us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529057.099880:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782529057.100044:0:5822:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d974de8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:5822:1869117117172352:0@lo:502: 00000040:00080000:1.0:1782529057.100073:0:5822:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1782529057.102146:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1782529057.102182:0:5774:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782529057.102214:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000771ac143/0x72bfdc08f7eab8ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.102226:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000771ac143/0x72bfdc08f7eab8ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782529057.102291:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782529057.102293:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529057.102294:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529057.102295:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529057.102297:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529057.102298:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529057.102299:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529057.102300:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529057.102301:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782529057.102302:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782529057.102304:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529057.102306:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782529057.102309:0:5774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1782529057.102311:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782529057.102322:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529057.102324:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529057.102324:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529057.102325:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529057.102326:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529057.102327:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529057.102328:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529057.102329:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782529057.102330:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782529057.102331:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529057.102337:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782529057.102375:0:5774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782529057.102393:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000098270f52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117172480:0@lo:253: 00000100:00100000:2.0:1782529057.102453:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529057.102497:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117172480 00000100:00100000:2.0:1782529057.102503:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117172480 00000100:00100000:2.0:1782529057.102548:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782529057.102556:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000bcaa2d49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5774:x1869117117172480:12345-0@lo:253: 20000000:01000000:2.0:1782529057.102583:0:5789:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782529057.102597:0:5789:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1782529057.104219:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set 000000004d3da3c1 going to sleep for 11 seconds 20000000:01000000:2.0:1782529057.138472:0:5789:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782529057.138494:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1782529057.138544:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782529057.138550:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782529057.138575:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.138595:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.138605:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.138646:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.138661:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 12 pid: 5788 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529057.138694:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003e97b0e6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869117117172608:0@lo:104: 00000100:00100000:1.0:1782529057.138763:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529057.138822:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set 00000000acf3ffc2 going to sleep for 11 seconds 00000100:00100000:2.0:1782529057.139177:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117172608 00000100:00100000:2.0:1782529057.139185:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117172608 00000100:00100000:2.0:1782529057.139229:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529057.139236:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000017c4f483 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5810:x1869117117172608:12345-0@lo:104: 00010000:00010000:2.0:1782529057.139249:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.139309:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529057.139324:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000017c4f483 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5810:x1869117117172608:12345-0@lo:104: Request processed in 89us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529057.139330:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1782529057.139353:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529057.139358:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.139365:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ae91c0a already unused, calling callback (0000000025ed7967) 10000000:00010000:2.0:1782529057.139369:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.139382:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529057.139388:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529057.139393:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529057.139424:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.139430:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529057.139449:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.139454:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 000000007ae91c0a/0x72bfdc08f7eab8ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8b5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529057.139468:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529057.139470:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529057.139471:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529057.139523:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026756ee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117172736:0@lo:103: 00000100:00100000:2.0:1782529057.139554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529057.139804:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117172736 00000100:00100000:1.0:1782529057.139809:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117172736 00010000:00010000:1.0:1782529057.139828:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 13 pid: 5788 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529057.139874:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782529057.139880:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000004c58a07a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3295:x1869117117172736:12345-0@lo:103: 00010000:00010000:1.0:1782529057.139891:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529057.139896:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 13 pid: 5788 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.139905:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 13 pid: 5788 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.139932:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.139940:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782529057.139953:0:5778:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001404809s 00010000:00010000:1.0:1782529057.139956:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.139962:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.139978:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.139983:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.139988:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008d4463ec already unused, calling callback (000000006d44a138) 00010000:00010000:1.0:1782529057.139992:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.139998:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.140005:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.140015:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529057.140049:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000004c58a07a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3295:x1869117117172736:12345-0@lo:103: Request processed in 168us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529057.140056:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782529057.140096:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026756ee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117172736:0@lo:103: 00010000:00010000:1.0:1782529057.140127:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f5e86784/0x72bfdc08f7eab8b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ae expref: 12 pid: 5788 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529057.140136:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003e97b0e6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869117117172608:0@lo:104: 00010000:00010000:1.0:1782529057.140146:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.140154:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.140165:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529057.140171:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008d4463ec/0x72bfdc08f7eab8e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529057.147523:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000bcaa2d49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5774:x1869117117172480:12345-0@lo:253: Request processed in 44960us (45062us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529057.147542:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782529057.147630:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000098270f52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:5774:1869117117172480:0@lo:253: 10000000:01000000:0.0:1782529057.147644:0:5774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782529057.147648:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782529057.147650:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782529057.147651:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782529057.147652:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782529057.147654:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782529057.147655:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782529057.147656:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782529057.147658:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782529057.147659:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782529057.147660:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782529057.147662:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782529057.147663:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782529057.147677:0:5774:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782529057.157665:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1782529057.158113:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782529057.158334:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1782529057.158502:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782529057.158698:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1782529057.158914:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1782529057.161686:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529057.161999:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1782529057.162175:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529057.162361:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1782529057.162533:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529057.162707:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1782529057.196866:0:5774:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:0.0:1782529057.223306:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1782529057.228424:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1782529057.228778:0:5828:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1782529057.231126:0:5827:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1782529057.231133:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1782529057.231772:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782529057.232104:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782529057.232530:0:5774:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782529057.232537:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782529057.232709:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529057.234142:0:5774:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1782529057.234693:0:5774:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782529057.234730:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1782529057.235245:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782529057.235448:0:5774:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1782529057.237246:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1782529057.237425:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1782529057.237586:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1782529057.237742:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1782529057.238210:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1782529057.238383:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1782529057.238518:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1782529057.238667:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1782529057.238811:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782529057.242745:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782529057.243089:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782529057.243258:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1782529057.243413:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782529057.243573:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1782529057.243757:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1782529057.244367:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782529057.244699:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782529057.244881:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1782529057.245029:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782529057.245166:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782529057.245303:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782529057.245476:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782529057.245632:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782529057.245791:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782529057.245960:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782529057.246099:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782529057.246234:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782529057.246389:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782529057.246554:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782529057.246716:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782529057.246889:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782529057.247043:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782529057.247224:0:5774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1782529057.274809:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1782529057.323150:0:5774:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782529057.323192:0:5774:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1b901c7b988 00100000:10000000:3.0:1782529057.323200:0:5774:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1782529057.324258:0:5774:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782529057.324274:0:5774:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782529057.324287:0:5774:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1782529057.324322:0:5774:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1782529057.326247:0:5828:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782529057.326331:0:5828:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782529057.326336:0:5828:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1782529058.257425:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529059.273032:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529060.299690:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529061.324711:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782529061.869079:0:6070:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1782529061.964656:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782529061.964665:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff99c646a6f800 from 3 10000000:01000000:1.0:1782529061.964670:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782529061.964729:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000208ce93d/0x72bfdc08f7eab8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529061.964741:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000208ce93d/0x72bfdc08f7eab8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529061.964753:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000208ce93d/0x72bfdc08f7eab8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529061.964813:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003e97b0e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117172864:0@lo:101: 00000100:00100000:1.0:1782529061.964920:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529061.964965:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 00000000225e4935 going to sleep for 11 seconds 00000100:00100000:3.0:1782529061.974475:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117172864 00000100:00100000:3.0:1782529061.974493:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117172864 00000100:00100000:3.0:1782529061.974563:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782529061.974572:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000aaf3b3c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5791:x1869117117172864:12345-0@lo:101: 00010000:00010000:3.0:1782529061.974593:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529061.974615:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009d330cf5/0x72bfdc08f7eab8f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab8ed expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529061.974649:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d330cf5/0x72bfdc08f7eab8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529061.974660:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009d330cf5/0x72bfdc08f7eab8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529061.974670:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009d330cf5, rc 0) 00000100:00100000:3.0:1782529061.974750:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000aaf3b3c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117172864:12345-0@lo:101: Request processed in 179us (9831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529061.974757:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782529061.974851:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003e97b0e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117172864:0@lo:101: 00010000:00010000:3.0:1782529061.974870:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000208ce93d/0x72bfdc08f7eab8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529061.974879:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000208ce93d/0x72bfdc08f7eab8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529061.974946:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031391d11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117172992:0@lo:256: 00000100:00100000:3.0:1782529061.974985:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529061.975019:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 000000001203b759 going to sleep for 11 seconds 00000100:00100000:3.0:1782529061.975033:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117172992 00000100:00100000:3.0:1782529061.975042:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117172992 00000100:00100000:3.0:1782529061.975083:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782529061.975089:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6aaa37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117172992:12345-0@lo:256: 20000000:01000000:3.0:1782529061.975102:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782529061.975118:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782529061.975121:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1782529061.975206:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6aaa37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117172992:12345-0@lo:256: Request processed in 117us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529061.975212:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782529061.975239:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031391d11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117172992:0@lo:256: 10000000:01000000:3.0:1782529061.975285:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782529061.975292:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000208ce93d/0x72bfdc08f7eab8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529061.975299:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000208ce93d/0x72bfdc08f7eab8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529062.343007:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782529062.471294:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1782529062.471303:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782529062.471305:0:36:0:(import.c:65:import_set_state_nolock()) 00000000b625acf5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782529062.471317:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b625acf5 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1782529062.471340:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c93697dd x1869117117173248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782529062.471437:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782529062.471451:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117173120:0@lo:400: 00000100:00100000:0.0:1782529062.471521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529062.471577:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c93697dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117173248:0@lo:38: 00000100:00100000:0.0:1782529062.471610:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529062.471640:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117173120 00000100:00100000:0.0:1782529062.471646:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117173120 00000100:00100000:0.0:1782529062.471693:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782529062.471702:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f665ff19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:3297:x1869117117173120:12345-0@lo:400: 00000100:00100000:0.0:1782529062.471759:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f665ff19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:3297:x1869117117173120:12345-0@lo:400: Request processed in 58us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529062.471766:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782529062.471812:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117173120:0@lo:400: 00000100:00100000:2.0:1782529062.471967:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117173248 00000100:00100000:2.0:1782529062.471971:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117173248 00000100:00100000:2.0:1782529062.471991:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529062.471995:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001592ede7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3293:x1869117117173248:12345-0@lo:38: 00010000:00080000:2.0:1782529062.472015:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:2.0:1782529062.472049:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72bfdc08f7eab8fb 00000004:00100000:2.0:1782529062.472154:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782529062.472254:0:5796:0:(import.c:65:import_set_state_nolock()) 00000000e88d805f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782529062.472302:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001592ede7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869117117173248:12345-0@lo:38: Request processed in 306us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529062.472308:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782529062.480582:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c93697dd x1869117117173248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782529072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782529062.480607:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782529062.480617:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782529062.480623:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782529062.480627:0:3293:0:(import.c:65:import_set_state_nolock()) 00000000b625acf5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782529062.480634:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c93697dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117173248:0@lo:38: 00010000:00010000:2.0:1782529063.367373:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529064.397288:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529065.415365:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529066.441800:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782529067.100402:0:6272:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc336b4bb0 20000000:00000080:3.0:1782529067.100428:0:6272:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99c68037e800 uarg=0000000000000000 20000000:01000000:3.0:1782529067.100473:0:6272:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782529067.100482:0:6272:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782529067.100489:0:6272:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782529067.101265:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782529067.101284:0:6272:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1782529067.106706:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782529067.107273:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782529067.107343:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1782529067.107413:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1782529067.107438:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782529067.107460:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529067.107491:0:6272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529067.107500:0:6272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529067.107549:0:6272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529067.107565:0:6272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 11 pid: 5788 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529067.107582:0:6272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a7aa76de pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6272:1869117117173376:0@lo:104: 00000100:00100000:2.0:1782529067.107675:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529067.107748:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117173376 00000100:00100000:2.0:1782529067.107750:0:6272:0:(client.c:2701:ptlrpc_set_wait()) set 00000000776cd632 going to sleep for 11 seconds 00000100:00100000:1.0:1782529067.107760:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117173376 00000100:00100000:1.0:1782529067.107826:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782529067.108097:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ede469a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:6272:x1869117117173376:12345-0@lo:104: 00010000:00010000:1.0:1782529067.108113:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108396:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782529067.108402:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ede469a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:6272:x1869117117173376:12345-0@lo:104: Request processed in 311us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529067.108412:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782529067.108441:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529067.108447:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108457:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000552c8aa8 already unused, calling callback (0000000025ed7967) 10000000:00010000:1.0:1782529067.108461:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108470:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782529067.108491:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529067.108497:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782529067.108532:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108539:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782529067.108560:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108567:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 00000000552c8aa8/0x72bfdc08f7eab8bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8c3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108584:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529067.108586:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529067.108587:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529067.108609:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006b9fc797 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117173504:0@lo:103: 00000100:00100000:1.0:1782529067.108645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529067.108693:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117173504 00000100:00100000:1.0:1782529067.108697:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117173504 00010000:00010000:1.0:1782529067.108718:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 12 pid: 5788 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529067.108741:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782529067.108748:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000042406130 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:3297:x1869117117173504:12345-0@lo:103: 00010000:00010000:1.0:1782529067.108759:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529067.108764:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 12 pid: 5788 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108781:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 12 pid: 5788 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108801:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108809:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108823:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108830:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108869:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108876:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108883:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000caceff1f already unused, calling callback (000000006d44a138) 00010000:00010000:1.0:1782529067.108887:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108895:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108903:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.108926:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529067.108971:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000042406130 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:3297:x1869117117173504:12345-0@lo:103: Request processed in 224us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529067.108978:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529067.109121:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006b9fc797 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117173504:0@lo:103: 00010000:00010000:3.0:1782529067.112079:0:6272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000001dc6f85/0x72bfdc08f7eab8c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab8bc expref: 11 pid: 5788 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529067.112108:0:6272:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a7aa76de pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6272:1869117117173376:0@lo:104: 00010000:00010000:3.0:1782529067.112144:0:6272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529067.112292:0:6272:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529067.112303:0:6272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529067.112310:0:6272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000caceff1f/0x72bfdc08f7eab902 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529067.463044:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529067.591856:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031391d11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117173632:0@lo:400: 00000100:00100000:0.0:1782529067.591976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529067.592165:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117173632 00000100:00100000:1.0:1782529067.592333:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117173632 00000100:00100000:1.0:1782529067.592400:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782529067.592410:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c93697dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117173632:12345-0@lo:400: 00000100:00100000:1.0:1782529067.602864:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c93697dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117173632:12345-0@lo:400: Request processed in 10440us (10874us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529067.602887:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782529067.603329:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000031391d11 x1869117117173632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529067.603378:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031391d11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117173632:0@lo:400: 00010000:00010000:1.0:1782529068.489075:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529069.511273:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529070.535511:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782529071.111131:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782529071.111142:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c646a6f800 from 1 10000000:01000000:1.0:1782529071.111149:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529071.111253:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000008722d198/0x72bfdc08f7eab909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529071.111268:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000008722d198/0x72bfdc08f7eab909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529071.111279:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000008722d198/0x72bfdc08f7eab909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529071.111311:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000105944e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117173760:0@lo:101: 00000100:00100000:1.0:1782529071.111409:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529071.111471:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ae7a8ce2 going to sleep for 11 seconds 00000100:00100000:0.0:1782529071.111570:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117173760 00000100:00100000:0.0:1782529071.111580:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117173760 00000100:00100000:0.0:1782529071.111659:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782529071.111668:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001bfa8976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+11:5791:x1869117117173760:12345-0@lo:101: 00010000:00010000:0.0:1782529071.111684:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529071.111702:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d0d89959/0x72bfdc08f7eab910 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab909 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529071.111731:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d0d89959/0x72bfdc08f7eab910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529071.111752:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d0d89959/0x72bfdc08f7eab910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529071.111760:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d0d89959, rc 0) 00000100:00100000:0.0:1782529071.111821:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001bfa8976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117173760:12345-0@lo:101: Request processed in 154us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529071.111829:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782529071.111933:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000105944e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117173760:0@lo:101: 00010000:00010000:0.0:1782529071.111949:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000008722d198/0x72bfdc08f7eab909 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529071.111958:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000008722d198/0x72bfdc08f7eab909 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529071.112039:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117173888:0@lo:501: 00000100:00100000:0.0:1782529071.112066:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529071.112090:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bfd33807 going to sleep for 11 seconds 00000100:00100000:0.0:1782529071.112103:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117173888 00000100:00100000:0.0:1782529071.112107:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117173888 00000100:00100000:0.0:1782529071.112127:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782529071.112132:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000970481d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117173888:12345-0@lo:501: 00000100:00100000:0.0:1782529071.112454:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000970481d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117173888:12345-0@lo:501: Request processed in 320us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529071.112463:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782529071.112497:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117173888:0@lo:501: 00000100:00100000:0.0:1782529071.112532:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117174016:0@lo:503: 00000100:00100000:0.0:1782529071.112574:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529071.112586:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d60f278b going to sleep for 11 seconds 00000100:00100000:0.0:1782529071.112598:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117174016 00000100:00100000:0.0:1782529071.112601:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117174016 00000100:00100000:0.0:1782529071.112621:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782529071.112626:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d032a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117174016:12345-0@lo:503: 00000100:00100000:0.0:1782529071.112783:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d032a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117174016:12345-0@lo:503: Request processed in 156us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529071.112789:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782529071.112822:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117174016:0@lo:503: 00000100:00100000:0.0:1782529071.113099:0:6507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6507:1869117117174144:0@lo:502: 00000100:00100000:0.0:1782529071.113134:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529071.113160:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117174144 00000100:00100000:0.0:1782529071.113164:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117174144 00000100:00100000:0.0:1782529071.113187:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782529071.113192:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000093a9860d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6507:x1869117117174144:12345-0@lo:502: 00000100:00100000:0.0:1782529071.113329:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000093a9860d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6507:x1869117117174144:12345-0@lo:502: Request processed in 137us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529071.113336:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782529071.113376:0:6507:0:(client.c:2701:ptlrpc_set_wait()) set 000000001fd33ded going to sleep for 11 seconds 00000100:00100000:0.0:1782529071.113391:0:6507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b15c9034 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6507:1869117117174144:0@lo:502: 00000020:01000000:0.0:1782529071.113413:0:6507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529071.113425:0:6507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529071.113428:0:6507:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782529071.113436:0:6507:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c646a6f800 00000020:00000080:0.0:1782529071.113438:0:6507:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782529071.113489:0:6507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6507:1869117117174272:0@lo:502: 00000100:00100000:0.0:1782529071.113521:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529071.113539:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117174272 00000100:00100000:0.0:1782529071.113542:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117174272 00000100:00100000:0.0:1782529071.113561:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782529071.113568:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6507:x1869117117174272:12345-0@lo:502: 00000100:00100000:0.0:1782529071.113663:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6507:x1869117117174272:12345-0@lo:502: Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529071.113670:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782529071.113694:0:6507:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642e9b000 going to sleep for 11 seconds 00000100:00100000:0.0:1782529071.113705:0:6507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6507:1869117117174272:0@lo:502: 00000020:01000000:0.0:1782529071.113722:0:6507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529071.113726:0:6507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529071.113728:0:6507:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782529071.113738:0:6507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1782529071.113801:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782529071.113825:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782529071.113878:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529071.113891:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529071.575320:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529072.592087:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529072.721172:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117174400:0@lo:400: 00000100:00100000:2.0:1782529072.721262:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529072.721338:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782529072.721346:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117174528:0@lo:400: 00000100:00100000:2.0:1782529072.721377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529072.721415:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117174400 00000100:00100000:2.0:1782529072.721424:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117174400 00000100:00100000:2.0:1782529072.721476:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782529072.721485:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:3295:x1869117117174400:12345-0@lo:400: 00000100:00100000:2.0:1782529072.721542:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:3295:x1869117117174400:12345-0@lo:400: Request processed in 57us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529072.721549:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782529072.721581:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117174528 00000100:00100000:2.0:1782529072.721585:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117174528 00000100:00100000:2.0:1782529072.721610:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529072.721616:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117174528:12345-0@lo:400: 00000100:00100000:2.0:1782529072.721650:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117174528:12345-0@lo:400: Request processed in 34us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529072.721656:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529072.721691:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117174400:0@lo:400: 00010000:00080000:2.0:1782529072.721727:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99c680009c00 x1869117117174528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529072.721739:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117174528:0@lo:400: 00000020:01000004:3.0:1782529073.188268:0:6588:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782529073.188272:0:6588:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1782529073.188414:0:6588:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99c6795ce000 00000020:01000004:3.0:1782529073.188431:0:6588:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782529073.188443:0:6588:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782529073.188458:0:6588:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99c645a43380) 00000020:00000080:3.0:1782529073.188472:0:6588:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782529073.208530:0:6588:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1782529073.208768:0:6588:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1782529073.244775:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1782529073.251189:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782529073.251226:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1782529073.251283:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782529073.251322:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1782529073.251634:0:6588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1782529073.251645:0:6588:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782529073.251655:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bfdc08f7eab91e 00000020:01000004:1.0:1782529073.251663:0:6588:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1782529073.251683:0:6588:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782529073.251687:0:6588:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782529073.251693:0:6588:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1782529073.251698:0:6588:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1782529073.251708:0:6588:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99c6457b4d40) 00000020:00000080:1.0:1782529073.251718:0:6588:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1782529073.257455:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529073.257640:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1782529073.257648:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1782529073.263005:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1782529073.263020:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1782529073.264434:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1782529073.264445:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1782529073.266477:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782529073.266654:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1782529073.266661:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782529073.269548:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782529073.269563:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1782529073.300677:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782529073.301297:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782529073.301305:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1782529073.302751:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782529073.302761:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782529073.305247:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782529073.305262:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782529073.308739:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782529073.309382:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1782529073.309389:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1782529073.316230:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1782529073.316249:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1782529073.394502:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782529073.395390:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1782529073.395399:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1782529073.396754:0:6588:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1782529073.396769:0:6588:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782529073.397702:0:6588:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782529073.397734:0:6588:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1782529073.397741:0:6588:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1782529073.418693:0:6588:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782529073.418732:0:6588:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1782529073.418737:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782529073.418738:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782529073.418739:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529073.418741:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529073.418742:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529073.418743:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529073.418745:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529073.418746:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782529073.418747:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782529073.418749:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529073.418750:0:6588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782529073.418754:0:6588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1782529073.418757:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782529073.418758:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782529073.418759:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529073.418760:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529073.418762:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529073.418763:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529073.418764:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529073.418765:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782529073.418766:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782529073.418768:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529073.418769:0:6588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782529073.419113:0:6588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782529073.419132:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117174656:0@lo:253: 00000100:00100000:3.0:1782529073.419221:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.419364:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6584e53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529073.419450:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117174656 00000100:00100000:1.0:1782529073.419457:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117174656 00000100:00100000:1.0:1782529073.419541:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782529073.419551:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117174656:12345-0@lo:253: 20000000:01000000:1.0:1782529073.419584:0:5789:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782529073.419589:0:5789:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1782529073.419594:0:5789:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1782529073.419598:0:5789:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1782529073.421402:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782529073.421611:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1782529073.421633:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1782529073.421675:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1782529073.421683:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1782529073.421708:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1782529073.421760:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1782529073.424778:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1782529073.424821:0:5789:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:1.0:1782529073.424824:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:1.0:1782529073.425457:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1782529073.425468:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782529073.425520:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1782529073.425527:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:1.0:1782529073.425552:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1782529073.425560:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1782529073.425583:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1782529073.425640:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1782529073.426730:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1782529073.426756:0:5789:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:1.0:1782529073.426758:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:1.0:1782529073.426806:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1782529073.426816:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1782529073.427196:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1782529073.427207:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:1.0:1782529073.427263:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1782529073.427273:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1782529073.427306:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1782529073.427341:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1782529073.427359:0:5789:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1782529073.427362:0:5789:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1782529073.427368:0:5789:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1782529073.427369:0:5789:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1782529073.427380:0:5789:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1782529073.427394:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782529073.427396:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1782529073.427430:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782529073.427433:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782529073.428166:0:6603:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1782529073.428467:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1782529073.428509:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1782529073.428571:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1782529073.428584:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782529073.428586:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782529073.429359:0:6604:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1782529073.429408:0:6604:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1782529073.429452:0:6604:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1782529073.429681:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1782529073.429742:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1782529073.430137:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1782529073.430152:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782529073.430154:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782529073.430574:0:6605:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1782529073.430631:0:6605:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1782529073.430683:0:6605:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1782529073.431312:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1782529073.431355:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1782529073.431389:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:1.0:1782529073.431404:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782529073.431425:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.431444:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eab845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.431452:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c65972ba00/0x72bfdc08f7eab861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.431459:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c682045000/0x72bfdc08f7eab8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.431467:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.431520:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c682045000/0x72bfdc08f7eab8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.431535:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c682045000/0x72bfdc08f7eab8d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 12 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.431549:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869117117174784:0@lo:104: 00000100:00100000:1.0:1782529073.431615:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782529073.431819:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c65972ba00/0x72bfdc08f7eab861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.431827:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c65972ba00/0x72bfdc08f7eab861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 12 pid: 5789 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.431874:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869117117174912:0@lo:104: 00000100:00100000:1.0:1782529073.431898:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782529073.432271:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eab845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.432281:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eab845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 12 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.432291:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869117117175040:0@lo:104: 00000100:00100000:1.0:1782529073.432315:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529073.432369:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117174784 00000100:00100000:2.0:1782529073.432376:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117174784 00000100:00100000:2.0:1782529073.432414:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117174912 00000100:00100000:2.0:1782529073.432417:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117174912 00000100:00100000:2.0:1782529073.432432:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529073.432441:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+4:5789:x1869117117174784:12345-0@lo:104: 00010000:00010000:2.0:1782529073.432454:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab8ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.432511:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529073.432517:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+4:5789:x1869117117174784:12345-0@lo:104: Request processed in 78us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529073.432524:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529073.432544:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782529073.432550:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5789:x1869117117174912:12345-0@lo:104: 00010000:00010000:2.0:1782529073.432556:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.432592:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782529073.432598:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5789:x1869117117174912:12345-0@lo:104: Request processed in 49us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529073.432603:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782529073.432660:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782529073.432668:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab8ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432675:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b400 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529073.432679:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab8ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432687:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529073.432695:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529073.432701:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782529073.432743:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab8ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432751:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782529073.432767:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab8ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432799:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab8ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8d1 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432813:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782529073.432816:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432821:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044e00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529073.432824:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432830:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529073.432868:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529073.432873:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782529073.432887:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab85a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432893:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782529073.432903:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab85a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432909:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab85a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab861 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.432919:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529073.432926:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529073.432928:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529073.433232:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117175168:0@lo:103: 00000100:00100000:2.0:1782529073.433265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529073.433320:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117175296:0@lo:103: 00000100:00100000:2.0:1782529073.433341:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529073.433452:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117175168 00000100:00100000:1.0:1782529073.433458:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117175168 00010000:00010000:1.0:1782529073.433479:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c682045000/0x72bfdc08f7eab8d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 13 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.433508:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117175296 00000100:00100000:1.0:1782529073.433511:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117175296 00010000:00010000:1.0:1782529073.433522:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c65972ba00/0x72bfdc08f7eab861 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 14 pid: 5789 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.433534:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529073.433539:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:3297:x1869117117175168:12345-0@lo:103: 00010000:00010000:1.0:1782529073.433551:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529073.433556:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c682045000/0x72bfdc08f7eab8d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 14 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.433566:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c682045000/0x72bfdc08f7eab8d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 14 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.433584:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529073.433613:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:3297:x1869117117175168:12345-0@lo:103: Request processed in 73us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529073.433620:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529073.433633:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529073.433638:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3294:x1869117117175296:12345-0@lo:103: 00010000:00010000:1.0:1782529073.433645:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529073.433649:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c65972ba00/0x72bfdc08f7eab861 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 13 pid: 5789 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.433658:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c65972ba00/0x72bfdc08f7eab861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 13 pid: 5789 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.433667:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529073.433699:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3294:x1869117117175296:12345-0@lo:103: Request processed in 61us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529073.433706:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529073.433760:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117175296:0@lo:103: 00000100:00100000:2.0:1782529073.434189:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117175040 00000100:00100000:2.0:1782529073.434194:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117175040 00000100:00100000:2.0:1782529073.434216:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782529073.434222:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5789:x1869117117175040:12345-0@lo:104: 00010000:00010000:2.0:1782529073.434233:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eab83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.434287:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529073.434294:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5789:x1869117117175040:12345-0@lo:104: Request processed in 72us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529073.434301:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1782529073.434317:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529073.434323:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eab83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.434330:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044a00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529073.434333:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eab83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.434342:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eab83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529073.434350:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eab83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529073.434356:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529073.434380:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eab83e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.434399:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529073.434418:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eab83e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.434424:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eab83e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab845 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.434441:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529073.434443:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529073.434444:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529073.434454:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117175424:0@lo:103: 00000100:00100000:2.0:1782529073.434483:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529073.434569:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117175168:0@lo:103: 00000100:00100000:1.0:1782529073.434591:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117175424 00000100:00100000:1.0:1782529073.434594:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117175424 00010000:00010000:1.0:1782529073.434608:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eab845 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 13 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.434625:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782529073.434631:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3295:x1869117117175424:12345-0@lo:103: 00010000:00010000:1.0:1782529073.434640:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529073.434645:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eab845 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 13 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434654:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eab845 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 13 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434668:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434677:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434692:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434700:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434716:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434723:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434729:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529073.434733:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434740:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434749:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.434759:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529073.434787:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3295:x1869117117175424:12345-0@lo:103: Request processed in 156us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529073.434995:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782529073.435034:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117175424:0@lo:103: 00000100:00100000:1.0:1782529073.435057:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646391900 going to sleep for 11 seconds 00010000:00010000:1.0:1782529073.435071:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682045000/0x72bfdc08f7eab8d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ca expref: 12 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.435082:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869117117174784:0@lo:104: 00010000:00010000:1.0:1782529073.435091:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972ba00/0x72bfdc08f7eab861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab85a expref: 11 pid: 5789 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.435112:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869117117174912:0@lo:104: 00010000:00010000:1.0:1782529073.435123:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eab845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab83e expref: 10 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.435132:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869117117175040:0@lo:104: 00010000:00010000:1.0:1782529073.435147:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.435157:0:5789:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.435165:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.435171:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a577a00/0x72bfdc08f7eab92c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782529073.435194:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1782529073.435547:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529073.482448:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+9:6588:x1869117117174656:12345-0@lo:253: Request processed in 62888us (63217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529073.482463:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782529073.482578:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117174656:0@lo:253: 10000000:01000000:3.0:1782529073.482595:0:6588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782529073.482598:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782529073.482599:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782529073.482601:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529073.482602:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1782529073.482603:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529073.482604:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529073.482606:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529073.482607:0:6588:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782529073.482609:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529073.482611:0:6588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782529073.482631:0:6588:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99c6795ce000 from lustre-OST0000 10000000:01000000:3.0:1782529073.482655:0:6588:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1782529073.482658:0:6588:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782529073.482664:0:6588:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99c6457b19c0 local copy 10000000:01000000:3.0:1782529073.482669:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782529073.482708:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.482719:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.482728:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529073.482747:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117175552:0@lo:101: 00000100:00100000:3.0:1782529073.482781:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.483081:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc240 going to sleep for 11 seconds 00000100:00100000:2.0:1782529073.483299:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117175552 00000100:00100000:2.0:1782529073.483306:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117175552 00000100:00100000:2.0:1782529073.483391:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782529073.483402:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+9:6588:x1869117117175552:12345-0@lo:101: 00010000:00010000:2.0:1782529073.483416:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529073.483431:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab93a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab933 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.483458:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab933 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.483468:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab933 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.483478:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:2.0:1782529073.483523:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+10:6588:x1869117117175552:12345-0@lo:101: Request processed in 123us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529073.483539:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782529073.483607:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117175552:0@lo:101: 00010000:00010000:3.0:1782529073.483623:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.483639:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529073.483732:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117175680:0@lo:501: 00000100:00100000:3.0:1782529073.483758:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.484032:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc240 going to sleep for 11 seconds 00000100:00100000:0.0:1782529073.484420:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117175680 00000100:00100000:0.0:1782529073.484434:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117175680 00000100:00100000:0.0:1782529073.484460:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782529073.484466:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+10:6588:x1869117117175680:12345-0@lo:501: 00000100:00100000:0.0:1782529073.484684:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+10:6588:x1869117117175680:12345-0@lo:501: Request processed in 216us (924us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782529073.484692:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782529073.484782:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117175680:0@lo:501: 10000000:01000000:3.0:1782529073.484810:0:6588:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782529073.484993:0:6588:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782529073.485000:0:6588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.485011:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.485017:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.485048:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782529073.485069:0:6588:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99c6795ce000 10000000:01000000:3.0:1782529073.485074:0:6588:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782529073.485079:0:6588:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99c6457b19c0 10000000:01000000:3.0:1782529073.485081:0:6588:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782529073.485085:0:6588:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff99c6457b19c0 from 1 10000000:01000000:3.0:1782529073.485087:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782529073.485112:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.485131:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.485139:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529073.485156:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117175808:0@lo:101: 00000100:00100000:3.0:1782529073.485200:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.485215:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc900 going to sleep for 11 seconds 00010000:00010000:0.0:1782529073.485285:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529073.485292:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.485299:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b400 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529073.485303:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.485312:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529073.485319:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529073.485324:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529073.485348:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.485354:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529073.485386:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.485393:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972b400/0x72bfdc08f7eab933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bfdc08f7eab93a expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.485422:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529073.485424:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529073.485425:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529073.485447:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117175808 00000100:00100000:0.0:1782529073.485452:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117175808 00000100:00100000:0.0:1782529073.485476:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782529073.485482:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+10:6588:x1869117117175808:12345-0@lo:101: 00010000:00010000:0.0:1782529073.485491:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529073.485504:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640031600/0x72bfdc08f7eab948 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab941 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.485525:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640031600/0x72bfdc08f7eab948 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab941 expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.485535:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640031600/0x72bfdc08f7eab948 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab941 expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.485543:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031600, rc 0) 00000100:00100000:0.0:1782529073.485573:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117175808:12345-0@lo:101: Request processed in 91us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.485579:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782529073.485802:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117175936:0@lo:103: 00000100:00100000:3.0:1782529073.486087:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.486151:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117175808:0@lo:101: 00010000:00010000:3.0:1782529073.486167:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab948 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.486187:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab948 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529073.486206:0:6588:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782529073.486219:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab948 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.486226:0:6588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab948 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529073.486234:0:6588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782529073.486238:0:6588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782529073.486251:0:6588:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782529073.486254:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782529073.486274:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.486281:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.486288:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529073.486301:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176064:0@lo:101: 00000100:00100000:3.0:1782529073.486325:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.486335:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc900 going to sleep for 11 seconds 00000100:00100000:0.0:1782529073.486398:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117175936 00000100:00100000:0.0:1782529073.486403:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117175936 00000100:00100000:0.0:1782529073.486441:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782529073.486449:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:3296:x1869117117175936:12345-0@lo:103: 00010000:00010000:0.0:1782529073.486460:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529073.486474:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab93a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eab933 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.486495:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529073.486527:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+10:3296:x1869117117175936:12345-0@lo:103: Request processed in 79us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.486534:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782529073.486559:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117175936:0@lo:103: 00000100:00100000:0.0:1782529073.486575:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117176064 00000100:00100000:0.0:1782529073.486578:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117176064 00000100:00100000:0.0:1782529073.486593:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782529073.486598:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+10:6588:x1869117117176064:12345-0@lo:101: 00010000:00010000:0.0:1782529073.486606:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529073.486615:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab94f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.486628:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.486636:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.486642:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030600, rc 0) 00000100:00100000:0.0:1782529073.486668:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176064:12345-0@lo:101: Request processed in 69us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.486673:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782529073.486807:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176064:0@lo:101: 00010000:00010000:3.0:1782529073.486818:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.486825:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529073.487062:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176192:0@lo:501: 00000100:00100000:3.0:1782529073.487087:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.487150:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc900 going to sleep for 11 seconds 00000100:00100000:1.0:1782529073.487359:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117176192 00000100:00100000:1.0:1782529073.487364:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117176192 00000100:00100000:0.0:1782529073.487551:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782529073.487560:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176192:12345-0@lo:501: 00000100:00100000:0.0:1782529073.487801:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176192:12345-0@lo:501: Request processed in 241us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.487815:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782529073.488138:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176192:0@lo:501: 00000100:00100000:3.0:1782529073.488173:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176320:0@lo:503: 00000100:00100000:3.0:1782529073.488224:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.488255:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc900 going to sleep for 11 seconds 00000100:00100000:0.0:1782529073.488311:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117176320 00000100:00100000:0.0:1782529073.488315:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117176320 00000100:00100000:0.0:1782529073.488346:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782529073.488352:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176320:12345-0@lo:503: 00000100:00100000:0.0:1782529073.488508:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176320:12345-0@lo:503: Request processed in 155us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.488515:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782529073.488590:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176320:0@lo:503: 00000040:00080000:3.0:1782529073.489071:0:6588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782529073.489146:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176448:0@lo:502: 00000100:00100000:3.0:1782529073.489197:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.489222:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc900 going to sleep for 11 seconds 00000100:00100000:2.0:1782529073.489293:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117176448 00000100:00100000:2.0:1782529073.489298:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117176448 00000100:00100000:2.0:1782529073.489622:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782529073.489634:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176448:12345-0@lo:502: 00000100:00100000:2.0:1782529073.489813:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176448:12345-0@lo:502: Request processed in 182us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529073.489820:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782529073.490274:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176448:0@lo:502: 00000040:00080000:3.0:1782529073.490544:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782529073.490597:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782529073.490628:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782529073.490671:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782529073.490703:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782529073.490737:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782529073.490769:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176576:0@lo:502: 00000100:00100000:3.0:1782529073.491170:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.491260:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc900 going to sleep for 11 seconds 00000100:00100000:0.0:1782529073.491464:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117176576 00000100:00100000:0.0:1782529073.491471:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117176576 00000100:00100000:0.0:1782529073.491510:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782529073.491518:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176576:12345-0@lo:502: 00000100:00100000:0.0:1782529073.491727:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176576:12345-0@lo:502: Request processed in 209us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.491734:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782529073.491868:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176576:0@lo:502: 00000040:00080000:3.0:1782529073.491975:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782529073.491987:0:6588:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1782529073.492803:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782529073.492813:0:6608:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1782529073.492820:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529073.492822:0:6608:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1782529073.492828:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782529073.493023:0:6608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99c67f363380) 00000020:00000080:1.0:1782529073.493046:0:6608:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782529073.493054:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782529073.493119:0:6608:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c6795ce000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1782529073.493127:0:6608:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782529073.493140:0:6608:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bfdc08f7eab964 00010000:00010000:0.0:1782529073.498158:0:6608:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1782529073.498462:0:6608:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1782529073.501682:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1782529073.502155:0:6608:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1782529073.509405:0:6608:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1782529073.510171:0:6608:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1782529073.511609:0:6608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782529073.511620:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529073.511628:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529073.511630:0:6608:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782529073.511633:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529073.511637:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529073.511638:0:6608:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782529073.511647:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782529073.511649:0:6608:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782529073.511697:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529073.511700:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529073.511701:0:6608:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782529073.511705:0:6608:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1782529073.512099:0:6588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1782529073.512124:0:6588:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782529073.512147:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.512160:0:6588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529073.512169:0:6588:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c6795ce000 from 1 10000000:01000000:1.0:1782529073.512172:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529073.512218:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.512226:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.512236:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.512259:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176704:0@lo:101: 00000100:00100000:1.0:1782529073.512321:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529073.512438:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782529073.519145:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117176704 00000100:00100000:2.0:1782529073.519159:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117176704 00000100:00100000:2.0:1782529073.519234:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782529073.519246:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:6588:x1869117117176704:12345-0@lo:101: 00010000:00010000:2.0:1782529073.519265:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529073.519285:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab96b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.519315:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.519326:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.519337:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044600, rc 0) 00000100:00100000:2.0:1782529073.519411:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117176704:12345-0@lo:101: Request processed in 167us (7089us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529073.519418:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782529073.520106:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176704:0@lo:101: 00010000:00010000:1.0:1782529073.520127:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.520137:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529073.520274:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176832:0@lo:501: 00000100:00100000:1.0:1782529073.520316:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529073.520358:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782529073.521208:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117176832 00000100:00100000:0.0:1782529073.521216:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117176832 00000100:00100000:0.0:1782529073.521259:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782529073.521268:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117176832:12345-0@lo:501: 00000100:00100000:0.0:1782529073.521531:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117176832:12345-0@lo:501: Request processed in 264us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.521539:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782529073.522090:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176832:0@lo:501: 00000100:00100000:1.0:1782529073.522138:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176960:0@lo:503: 00000100:00100000:1.0:1782529073.522197:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529073.522230:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782529073.522976:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117176960 00000100:00100000:0.0:1782529073.522983:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117176960 00000100:00100000:0.0:1782529073.523018:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782529073.523027:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117176960:12345-0@lo:503: 00000100:00100000:0.0:1782529073.523380:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117176960:12345-0@lo:503: Request processed in 353us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.523389:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782529073.523678:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117176960:0@lo:503: 00000040:00080000:3.0:1782529073.524155:0:6588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782529073.524232:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177088:0@lo:502: 00000100:00100000:3.0:1782529073.524280:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.524318:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc840 going to sleep for 11 seconds 00000100:00100000:0.0:1782529073.525980:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117177088 00000100:00100000:0.0:1782529073.525992:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117177088 00000100:00100000:0.0:1782529073.526045:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782529073.526053:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117177088:12345-0@lo:502: 00000100:00100000:0.0:1782529073.526314:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117177088:12345-0@lo:502: Request processed in 260us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.526323:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782529073.526456:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177088:0@lo:502: 00000040:00080000:3.0:1782529073.527132:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782529073.527216:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782529073.527261:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177216:0@lo:502: 00000100:00100000:3.0:1782529073.527317:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.527360:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782529073.528238:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117177216 00000100:00100000:0.0:1782529073.528246:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117177216 00000100:00100000:0.0:1782529073.528302:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782529073.528311:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117177216:12345-0@lo:502: 00000100:00100000:1.0:1782529073.532748:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117177216:12345-0@lo:502: Request processed in 4431us (5424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529073.532763:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782529073.533231:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177216:0@lo:502: 00000040:00080000:3.0:1782529073.533394:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782529073.533409:0:6588:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782529073.534226:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529073.534238:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529073.534240:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782529073.534247:0:6612:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c6795ce000 00000020:00000080:1.0:1782529073.534250:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782529073.534269:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529073.534272:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529073.534273:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782529073.534276:0:6612:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1782529073.534611:0:6588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782529073.534631:0:6588:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782529073.534657:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.534669:0:6588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529073.535291:0:6588:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782529073.535295:0:6588:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99c6795ce000 10000000:01000000:3.0:1782529073.535299:0:6588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99c6795ce000 10000000:01000000:3.0:1782529073.535303:0:6588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782529073.535309:0:6588:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c6795ce000 from 1 10000000:01000000:3.0:1782529073.535312:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782529073.535352:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.535361:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.535372:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529073.535395:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177344:0@lo:101: 00000100:00100000:3.0:1782529073.535465:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.535513:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529073.535564:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117177344 00000100:00100000:1.0:1782529073.535571:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117177344 00000100:00100000:1.0:1782529073.535619:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782529073.535628:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117177344:12345-0@lo:101: 00010000:00010000:1.0:1782529073.535644:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529073.535658:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab979 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.535696:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.535706:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.535715:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a576200, rc 0) 00000100:00100000:1.0:1782529073.535761:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6588:x1869117117177344:12345-0@lo:101: Request processed in 133us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529073.535769:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782529073.536194:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177344:0@lo:101: 00010000:00010000:2.0:1782529073.536221:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.536231:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529073.536332:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177472:0@lo:501: 00000100:00100000:2.0:1782529073.536363:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529073.536382:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648547d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529073.536445:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117177472 00000100:00100000:3.0:1782529073.536450:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117177472 00000100:00100000:3.0:1782529073.536472:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782529073.536477:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:6588:x1869117117177472:12345-0@lo:501: 00000100:00100000:3.0:1782529073.536705:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:6588:x1869117117177472:12345-0@lo:501: Request processed in 226us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529073.536712:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782529073.537069:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177472:0@lo:501: 00000100:00100000:2.0:1782529073.537102:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177600:0@lo:503: 00000100:00100000:2.0:1782529073.537144:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529073.537171:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648547d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529073.537220:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117177600 00000100:00100000:3.0:1782529073.537224:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117177600 00000100:00100000:3.0:1782529073.537253:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782529073.537260:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6588:x1869117117177600:12345-0@lo:503: 00000100:00100000:3.0:1782529073.537406:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6588:x1869117117177600:12345-0@lo:503: Request processed in 145us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529073.537413:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782529073.537796:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177600:0@lo:503: 00000040:00080000:2.0:1782529073.538111:0:6588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782529073.538193:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177728:0@lo:502: 00000100:00100000:2.0:1782529073.538237:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529073.538258:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648378780 going to sleep for 11 seconds 00000100:00100000:1.0:1782529073.538455:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117177728 00000100:00100000:1.0:1782529073.538460:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117177728 00000100:00100000:1.0:1782529073.538494:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782529073.538502:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6588:x1869117117177728:12345-0@lo:502: 00000100:00100000:1.0:1782529073.538689:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6588:x1869117117177728:12345-0@lo:502: Request processed in 188us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529073.538696:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782529073.539236:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177728:0@lo:502: 00000040:00080000:2.0:1782529073.539487:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782529073.539531:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782529073.539559:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782529073.539597:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782529073.540370:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782529073.540444:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782529073.540475:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782529073.540498:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782529073.540549:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782529073.540584:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782529073.540618:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782529073.540673:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782529073.540726:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782529073.540762:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782529073.541130:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782529073.541171:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782529073.541219:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782529073.541268:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782529073.541301:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782529073.541332:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782529073.541380:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782529073.541416:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782529073.541449:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782529073.541497:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782529073.541533:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782529073.541566:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782529073.541631:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782529073.541671:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1782529073.541721:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177856:0@lo:502: 00000100:00100000:2.0:1782529073.541812:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529073.542405:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648547d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529073.542753:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117177856 00000100:00100000:1.0:1782529073.542760:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117177856 00000100:00100000:1.0:1782529073.543210:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782529073.543220:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6588:x1869117117177856:12345-0@lo:502: 00000100:00100000:1.0:1782529073.543549:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6588:x1869117117177856:12345-0@lo:502: Request processed in 330us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529073.543557:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782529073.543635:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117177856:0@lo:502: 00000040:00080000:3.0:1782529073.543745:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782529073.543761:0:6588:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1782529073.544719:0:6613:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782529073.544734:0:6613:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99c67f360000) 00000020:00000080:1.0:1782529073.544755:0:6613:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1782529073.545456:0:6613:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c6795ce000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782529073.545461:0:6613:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c6795ce000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782529073.545463:0:6613:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c6795ce000 3 00010000:00080000:1.0:1782529073.545494:0:6613:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c67f623000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1782529073.547606:0:6613:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1782529073.547707:0:6613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782529073.547746:0:6613:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782529073.547758:0:6613:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72bfdc08f7eab98e 00000100:00080000:1.0:1782529073.547769:0:6613:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782529073.547775:0:6613:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99c67f623000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529073.549039:0:6613:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c6457f4000 x1869117117177984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782529073.549120:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3293:1869117117177984:0@lo:38: 00000100:00100000:0.0:1782529073.549227:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782529073.549296:0:6613:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782529073.549464:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117177984 00000100:00100000:2.0:1782529073.549471:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117177984 00000100:00100000:2.0:1782529073.549508:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529073.549516:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3293:x1869117117177984:12345-0@lo:38: 00010000:00080000:2.0:1782529073.549559:0:5795:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:2.0:1782529073.549594:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72bfdc08f7eab995 00000004:00100000:2.0:1782529073.549614:0:5795:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782529073.549650:0:5795:0:(import.c:65:import_set_state_nolock()) ffff99c67f609800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1782529073.553382:0:6613:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1782529073.553989:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117178112:0@lo:400: 00000100:00100000:0.0:1782529073.554059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529073.554128:0:5796:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782529073.554136:0:5796:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:01000000:3.0:1782529073.555077:0:6588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1782529073.555114:0:6588:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782529073.555141:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529073.555153:0:6588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782529073.555213:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782529073.555218:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782529073.555219:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529073.555220:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529073.555221:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529073.555223:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529073.555224:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529073.555225:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782529073.555226:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782529073.555228:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529073.555229:0:6588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782529073.555233:0:6588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1782529073.555235:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782529073.555236:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782529073.555237:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529073.555238:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529073.555239:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529073.555240:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529073.555241:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529073.555242:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782529073.555243:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782529073.555244:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529073.555245:0:6588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782529073.555267:0:6588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782529073.555281:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117178240:0@lo:253: 00000100:00100000:3.0:1782529073.555332:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529073.555361:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6584e53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529073.555394:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117178240 00000100:00100000:3.0:1782529073.555401:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117178240 00000100:00100000:3.0:1782529073.555445:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782529073.555454:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6588:x1869117117178240:12345-0@lo:253: 20000000:01000000:3.0:1782529073.555485:0:5788:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782529073.555498:0:5788:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1782529073.557132:0:5794:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1782529073.557147:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117178112 00000100:00100000:3.0:1782529073.557154:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117178112 00000100:00100000:3.0:1782529073.557197:0:5794:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1782529073.557206:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782529073.557222:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117178112:12345-0@lo:400: 00000100:00100000:3.0:1782529073.557302:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117178112:12345-0@lo:400: Request processed in 81us (3243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529073.557310:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529073.559353:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869117117177984:12345-0@lo:38: Request processed in 9829us (10120us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529073.559366:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782529073.559504:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99c6457f4000 x1869117117177984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782529083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529073.559516:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782529073.559526:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1782529073.559535:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782529073.559540:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782529073.559543:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c67f623000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782529073.559551:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3293:1869117117177984:0@lo:38: 00010000:00080000:0.0:1782529073.559646:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99c680cded80 x1869117117178112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529073.559657:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117178112:0@lo:400: 20000000:01000000:1.0:1782529073.594574:0:5788:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782529073.594628:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782529073.595508:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782529073.595514:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782529073.595539:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.595558:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eab8f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.595567:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.595610:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eab8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529073.595626:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eab8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 13 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529073.595640:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869117117178368:0@lo:104: 00000100:00100000:2.0:1782529073.595706:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529073.595771:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270180 going to sleep for 11 seconds 00000100:00100000:1.0:1782529073.596090:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117178368 00000100:00100000:1.0:1782529073.596099:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117178368 00000100:00100000:1.0:1782529073.596152:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782529073.596162:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5810:x1869117117178368:12345-0@lo:104: 00010000:00010000:1.0:1782529073.596187:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c64a577e00/0x72bfdc08f7eab8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529073.596252:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782529073.596258:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5810:x1869117117178368:12345-0@lo:104: Request processed in 98us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529073.596266:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782529073.596346:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869117117178368:0@lo:104: 00010000:00010000:3.0:1782529073.596372:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596573:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529073.596581:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c64a577e00/0x72bfdc08f7eab8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596588:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577e00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529073.596592:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c64a577e00/0x72bfdc08f7eab8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596618:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c64a577e00/0x72bfdc08f7eab8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529073.596625:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c64a577e00/0x72bfdc08f7eab8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529073.596631:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529073.596672:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c64a577e00/0x72bfdc08f7eab8ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596679:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529073.596703:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c64a577e00/0x72bfdc08f7eab8ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596711:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c64a577e00/0x72bfdc08f7eab8ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab8f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596727:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529073.596728:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529073.596730:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529073.596739:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529073.596749:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117178496:0@lo:103: 00000100:00100000:0.0:1782529073.596799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529073.596880:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117178496 00000100:00100000:0.0:1782529073.596885:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117178496 00010000:00010000:0.0:1782529073.596904:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eab8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 14 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529073.596925:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782529073.596932:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650285850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:3295:x1869117117178496:12345-0@lo:103: 00010000:00010000:0.0:1782529073.596951:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529073.596957:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eab8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 14 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596967:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eab8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 14 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596981:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eab8f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab8ed expref: 14 pid: 5788 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.596994:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597002:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782529073.597017:0:5778:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001503985s 00010000:00010000:0.0:1782529073.597021:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597028:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597035:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597041:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597046:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529073.597051:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597066:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597081:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597090:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529073.597119:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650285850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3295:x1869117117178496:12345-0@lo:103: Request processed in 188us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529073.597126:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782529073.597192:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117178496:0@lo:103: 00010000:00010000:0.0:1782529073.597217:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597225:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529073.597231:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682045200/0x72bfdc08f7eab99c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529073.605670:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:6588:x1869117117178240:12345-0@lo:253: Request processed in 50209us (50330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529073.605685:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782529073.605798:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:6588:1869117117178240:0@lo:253: 10000000:01000000:1.0:1782529073.605995:0:6588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782529073.605999:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782529073.606000:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782529073.606002:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782529073.606003:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782529073.606005:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782529073.606006:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782529073.606007:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782529073.606009:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782529073.606010:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782529073.606011:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782529073.606013:0:6588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782529073.606029:0:6588:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1782529073.609248:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1782529073.612286:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782529073.612478:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782529073.612679:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782529073.613023:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782529073.613252:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782529073.613486:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1782529073.615495:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1782529073.895794:0:6588:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782529073.895802:0:6588:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782529073.895870:0:6588:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782529073.895944:0:6588:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782529073.895962:0:6588:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1782529073.895983:0:6588:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1782529074.631929:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529075.655696:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529076.680190:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782529076.935913:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782529076.935922:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c646a6f800 from 21 10000000:01000000:2.0:1782529076.935928:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782529076.935979:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.935992:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.936023:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529076.936050:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117178624:0@lo:101: 00000100:00100000:2.0:1782529076.936117:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529076.936181:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270840 going to sleep for 11 seconds 00000100:00100000:2.0:1782529076.936204:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117178624 00000100:00100000:2.0:1782529076.936210:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117178624 00000100:00100000:2.0:1782529076.936259:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782529076.936267:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117178624:12345-0@lo:101: 00010000:00010000:2.0:1782529076.936283:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529076.936296:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab9a3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.936321:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.936333:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.936342:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:2.0:1782529076.936382:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117178624:12345-0@lo:101: Request processed in 114us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529076.936388:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782529076.936437:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117178624:0@lo:101: 00010000:00010000:2.0:1782529076.936452:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.936471:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529076.936524:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117178752:0@lo:501: 00000100:00100000:2.0:1782529076.936549:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529076.936563:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270840 going to sleep for 11 seconds 00000100:00100000:2.0:1782529076.937918:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117178752 00000100:00100000:2.0:1782529076.937930:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117178752 00000100:00100000:2.0:1782529076.937982:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782529076.937990:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117178752:12345-0@lo:501: 00000100:00100000:2.0:1782529076.938287:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117178752:12345-0@lo:501: Request processed in 296us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529076.938294:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782529076.938345:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117178752:0@lo:501: 00000100:00100000:2.0:1782529076.938387:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117178880:0@lo:503: 00000100:00100000:2.0:1782529076.938428:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529076.938585:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117178880 00000100:00100000:0.0:1782529076.938590:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117178880 00000100:00100000:0.0:1782529076.938617:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782529076.938623:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117178880:12345-0@lo:503: 00000100:00100000:0.0:1782529076.938814:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117178880:12345-0@lo:503: Request processed in 190us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529076.938822:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782529076.939087:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270840 going to sleep for 11 seconds 00000100:00100000:2.0:1782529076.939104:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117178880:0@lo:503: 00000100:00100000:0.0:1782529076.940377:0:6759:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6759:1869117117179008:0@lo:502: 00000100:00100000:0.0:1782529076.940444:0:6759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529076.940483:0:6759:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f5f8480 going to sleep for 11 seconds 00000100:00100000:2.0:1782529076.940528:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117179008 00000100:00100000:2.0:1782529076.940534:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117179008 00000100:00100000:2.0:1782529076.940576:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782529076.940585:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6759:x1869117117179008:12345-0@lo:502: 00000100:00100000:2.0:1782529076.940997:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6759:x1869117117179008:12345-0@lo:502: Request processed in 411us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529076.941004:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782529076.941977:0:6759:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6759:1869117117179008:0@lo:502: 00000100:00100000:0.0:1782529076.942043:0:6759:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6759:1869117117179136:0@lo:502: 00000100:00100000:0.0:1782529076.942088:0:6759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529076.942123:0:6759:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f5f8480 going to sleep for 11 seconds 00000100:00100000:2.0:1782529076.942889:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117179136 00000100:00100000:2.0:1782529076.942897:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117179136 00000100:00100000:2.0:1782529076.942942:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782529076.942952:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6759:x1869117117179136:12345-0@lo:502: 00000100:00100000:2.0:1782529076.943183:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:6759:x1869117117179136:12345-0@lo:502: Request processed in 231us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529076.943191:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782529076.943373:0:6759:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6759:1869117117179136:0@lo:502: 00000040:00080000:0.0:1782529076.943401:0:6759:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1782529076.943944:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1782529076.943967:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782529076.943978:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.943990:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529076.943999:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782529076.944001:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff99c646a6f800 from 4 10000000:01000000:2.0:1782529076.944005:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782529076.944040:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.944049:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529076.944060:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529076.944079:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179264:0@lo:101: 00000100:00100000:2.0:1782529076.944120:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529076.944167:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529076.944741:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117179264 00000100:00100000:0.0:1782529076.944749:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117179264 00000100:00100000:0.0:1782529076.944959:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782529076.944968:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117179264:12345-0@lo:101: 00010000:00010000:0.0:1782529076.944983:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529076.944999:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab9b1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529076.945026:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529076.945050:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529076.945060:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031000, rc 0) 00000100:00100000:0.0:1782529076.945106:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117179264:12345-0@lo:101: Request processed in 139us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529076.945113:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782529076.947538:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179264:0@lo:101: 00010000:00010000:3.0:1782529076.947569:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529076.947581:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529076.947652:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179392:0@lo:256: 00000100:00100000:3.0:1782529076.947715:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529076.947772:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646af0240 going to sleep for 11 seconds 00000100:00100000:0.0:1782529076.947983:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117179392 00000100:00100000:0.0:1782529076.947990:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117179392 00000100:00100000:0.0:1782529076.948039:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782529076.948049:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117179392:12345-0@lo:256: 20000000:01000000:0.0:1782529076.948070:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782529076.948085:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782529076.948088:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1782529076.948181:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117179392:12345-0@lo:256: Request processed in 132us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529076.948190:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782529076.948897:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179392:0@lo:256: 10000000:01000000:3.0:1782529076.948948:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782529076.948957:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529076.948976:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529076.948985:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782529076.948988:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1782529076.948990:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782529076.949019:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529076.949027:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529076.949037:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529076.949053:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179520:0@lo:101: 00000100:00100000:3.0:1782529076.949087:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529076.949120:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646af0240 going to sleep for 11 seconds 00000100:00100000:1.0:1782529076.949315:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117179520 00000100:00100000:1.0:1782529076.949321:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117179520 00000100:00100000:1.0:1782529076.949361:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782529076.949369:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117179520:12345-0@lo:101: 00010000:00010000:1.0:1782529076.949379:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529076.949392:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab9bf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529076.949415:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529076.949426:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529076.949448:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a576400, rc 0) 00000100:00100000:1.0:1782529076.949480:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117179520:12345-0@lo:101: Request processed in 112us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529076.949487:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782529076.952005:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179520:0@lo:101: 00010000:00010000:3.0:1782529076.952034:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529076.952047:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529076.952122:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179648:0@lo:501: 00000100:00100000:3.0:1782529076.952190:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529076.952242:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646af0240 going to sleep for 11 seconds 00000100:00100000:0.0:1782529076.952429:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117179648 00000100:00100000:0.0:1782529076.952437:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117179648 00000100:00100000:0.0:1782529076.952483:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782529076.952493:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117179648:12345-0@lo:501: 00000100:00100000:0.0:1782529076.952768:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117179648:12345-0@lo:501: Request processed in 276us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529076.952775:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782529076.953144:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179648:0@lo:501: 00000100:00100000:3.0:1782529076.953195:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179776:0@lo:503: 00000100:00100000:3.0:1782529076.953237:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529076.953265:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646af0240 going to sleep for 11 seconds 00000100:00100000:0.0:1782529076.953343:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117179776 00000100:00100000:0.0:1782529076.953348:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117179776 00000100:00100000:0.0:1782529076.953383:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782529076.953397:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117179776:12345-0@lo:503: 00000100:00100000:0.0:1782529076.953624:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117179776:12345-0@lo:503: Request processed in 227us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529076.953631:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782529076.953959:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117179776:0@lo:503: 00000100:00100000:2.0:1782529076.958055:0:6763:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6763:1869117117179904:0@lo:502: 00000100:00100000:2.0:1782529076.958138:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529076.958195:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117179904 00000100:00100000:2.0:1782529076.958202:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117179904 00000100:00100000:2.0:1782529076.958244:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782529076.958254:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:6763:x1869117117179904:12345-0@lo:502: 00000100:00100000:2.0:1782529076.958549:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:6763:x1869117117179904:12345-0@lo:502: Request processed in 295us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529076.958557:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782529076.958607:0:6763:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270600 going to sleep for 11 seconds 00000100:00100000:2.0:1782529076.958628:0:6763:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6763:1869117117179904:0@lo:502: 00000020:01000000:2.0:1782529076.958656:0:6763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782529076.958664:0:6763:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782529076.958670:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529076.958673:0:6763:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782529076.958694:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782529076.958698:0:6763:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:2.0:1782529076.958720:0:6763:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782529076.958723:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782529076.958739:0:6763:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99c645aa4d40) 00000020:00000080:2.0:1782529076.958758:0:6763:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1782529076.958764:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782529076.958830:0:6763:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1782529076.960972:0:6763:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1782529076.961014:0:6763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eab9d4 00010000:00080000:2.0:1782529076.961058:0:6763:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c6587e1800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1782529076.961302:0:6763:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782529077.044255:0:6763:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782529077.044290:0:6763:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782529077.045051:0:6763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782529077.045265:0:6763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782529077.045451:0:6763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1782529077.045519:0:6763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1782529077.061646:0:6767:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782529077.061655:0:6767:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782529077.065640:0:6763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782529077.065655:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782529077.065711:0:6763:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782529077.065734:0:6763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eab9db 00000100:00080000:3.0:1782529077.065745:0:6763:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782529077.065751:0:6763:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99c6587e1800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1782529077.065802:0:6763:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c680cdf800 x1869117117180032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782529077.065827:0:6763:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1782529077.066873:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117180032:0@lo:8: 00000100:00100000:0.0:1782529077.066957:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529077.068044:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117180032 00000100:00100000:1.0:1782529077.068055:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117180032 00000100:00100000:1.0:1782529077.068096:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782529077.068104:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3293:x1869117117180032:12345-0@lo:8: 00010000:00080000:1.0:1782529077.068132:0:6591:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:1.0:1782529077.068171:0:6591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eab9e2 00002000:00100000:1.0:1782529077.068211:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99c67f626000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113663 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1782529077.068216:0:6591:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1782529077.068220:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782529077.068346:0:6591:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782529077.068478:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782529077.068505:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c67f620000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529077.068583:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1869117117180032:12345-0@lo:8: Request processed in 478us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529077.068591:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1782529077.070434:0:6763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529077.070443:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529077.070445:0:6763:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782529077.070449:0:6763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529077.070453:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529077.070455:0:6763:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782529077.070458:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782529077.070459:0:6763:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782529077.070504:0:6763:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6763:1869117117180160:0@lo:502: 00000100:00100000:3.0:1782529077.070584:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529077.070622:0:6763:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646af0600 going to sleep for 11 seconds 00010000:00080000:0.0:1782529077.071512:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cdf800 x1869117117180032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782529087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529077.071524:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782529077.071533:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782529077.071542:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782529077.071548:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782529077.071551:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6587e1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782529077.071562:0:3293:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782529077.071569:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117180032:0@lo:8: 00000004:00080000:0.0:1782529077.071601:0:6767:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782529077.071750:0:6767:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 138983916045ns, next at 0ns, rc = 0 00000100:00100000:2.0:1782529077.072738:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117180160 00000100:00100000:2.0:1782529077.072748:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117180160 00000100:00100000:2.0:1782529077.072803:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782529077.072813:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:6763:x1869117117180160:12345-0@lo:502: 00000100:00100000:2.0:1782529077.073097:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:6763:x1869117117180160:12345-0@lo:502: Request processed in 285us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529077.073105:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782529077.073563:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529077.073578:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117180288:0@lo:400: 00000100:00100000:1.0:1782529077.073623:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529077.073671:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117180288 00000100:00100000:1.0:1782529077.073675:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117180288 00000100:00100000:1.0:1782529077.073711:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529077.073718:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117180288:12345-0@lo:400: 00000100:00100000:1.0:1782529077.073764:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117180288:12345-0@lo:400: Request processed in 39us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529077.073771:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782529077.073807:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f4380 x1869117117180288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529077.073822:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117180288:0@lo:400: 00000100:00100000:2.0:1782529077.074112:0:6763:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:6763:1869117117180160:0@lo:502: 00000020:01000000:2.0:1782529077.074143:0:6763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782529077.074164:0:6763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529077.074167:0:6763:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782529077.074172:0:6763:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1782529077.078403:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117180416:0@lo:400: 00000100:00100000:0.0:1782529077.078477:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1782529077.078537:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1782529077.078563:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782529077.078576:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529077.078586:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529077.078606:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782529077.078608:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff99c6457b19c0 from 1 10000000:01000000:0.0:1782529077.078611:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782529077.078647:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529077.078654:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529077.078664:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529077.078678:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117180544:0@lo:101: 00000100:00100000:0.0:1782529077.078704:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529077.078717:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f5f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529077.078817:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117180416 00000100:00100000:0.0:1782529077.078823:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117180416 00000100:00100000:0.0:1782529077.078896:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782529077.078905:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117180416:12345-0@lo:400: 00000100:00100000:0.0:1782529077.078975:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117180416:12345-0@lo:400: Request processed in 71us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529077.078982:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782529077.079004:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117180544 00000100:00100000:0.0:1782529077.079007:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117180544 00000100:00100000:0.0:1782529077.079030:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782529077.079036:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117180544:12345-0@lo:101: 00010000:00010000:0.0:1782529077.079044:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529077.079060:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eab9e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529077.079083:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529077.079093:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529077.079103:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030000, rc 0) 00000100:00100000:0.0:1782529077.079134:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117180544:12345-0@lo:101: Request processed in 98us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529077.079139:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1782529077.079177:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782529077.079204:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f4a80 x1869117117180416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529077.079217:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117180416:0@lo:400: 00000100:00100000:0.0:1782529077.079244:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117180544:0@lo:101: 00010000:00010000:0.0:1782529077.079256:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529077.079265:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529077.079307:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117180672:0@lo:501: 00000100:00100000:0.0:1782529077.079336:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529077.079356:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646111b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782529077.079368:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117180672 00000100:00100000:0.0:1782529077.079376:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117180672 00000100:00100000:0.0:1782529077.079395:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782529077.079400:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117180672:12345-0@lo:501: 00000100:00100000:0.0:1782529077.079612:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117180672:12345-0@lo:501: Request processed in 210us (273us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782529077.079619:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782529077.079648:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117180672:0@lo:501: 10000000:01000000:0.0:1782529077.079665:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782529077.079671:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529077.079677:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782529077.224201:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1782529077.321063:0:6769:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782529077.321098:0:6769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1869117117180928:0@lo:7: 00000100:00100000:1.0:1782529077.321197:0:6769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529077.321241:0:6769:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:1.0:1782529077.321257:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117180800:0@lo:13: 00000100:00100000:1.0:1782529077.321281:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529077.321323:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117180928 00000100:00100000:1.0:1782529077.321329:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117180928 00000100:00100000:1.0:1782529077.321381:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782529077.321389:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6769:x1869117117180928:12345-0@lo:7: 00000100:00080000:0.0:1782529077.326644:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529077.338154:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117180800 00000100:00100000:3.0:1782529077.338171:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117180800 00000100:00100000:3.0:1782529077.338257:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782529077.338268:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1869117117180800:12345-0@lo:13: 00002000:00000024:3.0:1782529077.338311:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1782529077.338401:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1869117117180800:12345-0@lo:13: Request processed in 134us (17117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529077.338408:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782529077.338472:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f4380 x1869117117180800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529077.338494:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117180800:0@lo:13: 00002000:00080000:1.0:1782529077.349876:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1782529077.349885:0:6593:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782529077.349986:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6769:x1869117117180928:12345-0@lo:7: Request processed in 28592us (28784us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529077.349997:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782529077.350063:0:6769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f6a00 x1869117117180928/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782529093 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529077.350079:0:6769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1869117117180928:0@lo:7: 00000004:00080000:1.0:1782529077.350100:0:6769:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782529077.350139:0:6769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1869117117181056:0@lo:5: 00000100:00100000:1.0:1782529077.350184:0:6769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529077.350227:0:6769:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:1.0:1782529077.350248:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117181056 00000100:00100000:1.0:1782529077.350254:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117181056 00000100:00100000:1.0:1782529077.350290:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529077.350299:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6769:x1869117117181056:12345-0@lo:5: 00002000:00080000:1.0:1782529077.350328:0:6592:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782529077.350332:0:6592:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1782529077.350553:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6769:x1869117117181056:12345-0@lo:5: Request processed in 254us (368us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782529077.350560:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782529077.350589:0:6769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f6a00 x1869117117181056/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782529093 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529077.350616:0:6769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1869117117181056:0@lo:5: 00000004:00080000:1.0:1782529077.350624:0:6769:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782529077.350648:0:6769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1869117117181184:0@lo:700: 00000100:00100000:1.0:1782529077.350672:0:6769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529077.350697:0:6769:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:3.0:1782529077.362983:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117181184 00000100:00100000:3.0:1782529077.362999:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117181184 00000100:00100000:3.0:1782529077.363059:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782529077.363070:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6769:x1869117117181184:12345-0@lo:700: 00000100:00100000:3.0:1782529077.363134:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6599:1869117117181312:0@lo:700: 00000100:00100000:3.0:1782529077.363216:0:6599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529077.363255:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646af0300 going to sleep for 11 seconds 00000100:00100000:3.0:1782529077.363280:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117181312 00000100:00100000:3.0:1782529077.363283:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117181312 00000100:00100000:3.0:1782529077.363310:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782529077.363316:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6599:x1869117117181312:12345-0@lo:700: 40000000:02000000:0.0:1782529077.466931:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1782529077.478231:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6599:x1869117117181312:12345-0@lo:700: Request processed in 114906us (115006us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529077.478263:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782529077.481506:0:6599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cde680 x1869117117181312/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782529093 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529077.481524:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6599:1869117117181312:0@lo:700: 40000000:02000000:3.0:1782529077.481539:0:6599:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1782529077.596178:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1782529077.596214:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782529077.600977:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6769:x1869117117181184:12345-0@lo:700: Request processed in 237900us (250293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529077.600992:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782529077.601056:0:6769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f4380 x1869117117181184/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782529093 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529077.601068:0:6769:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782529077.601087:0:6769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1869117117181184:0@lo:700: 00010000:00010000:0.0:1782529077.703179:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1782529077.757524:0:6769:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1782529077.765600:0:6769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1869117117181440:0@lo:5: 00000100:00100000:1.0:1782529077.765671:0:6769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529077.765731:0:6769:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:2.0:1782529077.765877:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117181440 00000100:00100000:2.0:1782529077.765885:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117181440 00000100:00100000:2.0:1782529077.765933:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782529077.765941:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6769:x1869117117181440:12345-0@lo:5: 00002000:00080000:2.0:1782529077.776276:0:6592:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1782529077.776296:0:6592:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1782529077.781444:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6769:x1869117117181440:12345-0@lo:5: Request processed in 15495us (15765us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782529077.781457:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782529077.781648:0:6769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f4380 x1869117117181440/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782529093 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529077.781667:0:6769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1869117117181440:0@lo:5: 00000004:00080000:3.0:1782529077.781683:0:6769:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1782529078.728052:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529079.773300:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529080.787029:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529081.809714:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529082.439113:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782529082.439138:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117181568:0@lo:13: 00000100:00100000:3.0:1782529082.439215:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529082.439279:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117181568 00000100:00100000:3.0:1782529082.439287:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117181568 00000100:00100000:3.0:1782529082.439348:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782529082.439357:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869117117181568:12345-0@lo:13: 00002000:00000024:3.0:1782529082.439396:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529082.439440:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869117117181568:12345-0@lo:13: Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529082.439448:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1782529082.439473:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782529082.439506:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cde680 x1869117117181568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529082.439526:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117181568:0@lo:13: 00000100:00100000:2.0:1782529082.442946:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782529082.442970:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117181696:0@lo:400: 00000100:00100000:2.0:1782529082.443041:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529082.443882:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117181824:0@lo:400: 00000100:00100000:1.0:1782529082.443999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529082.444031:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529082.444038:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117181952:0@lo:400: 00000100:00100000:1.0:1782529082.444061:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529082.444094:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117181824 00000100:00100000:1.0:1782529082.444113:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117181824 00000100:00100000:1.0:1782529082.444159:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117181952 00000100:00100000:1.0:1782529082.444162:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117181952 00000100:00080000:3.0:1782529082.444829:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529082.444964:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117181696 00000100:00100000:0.0:1782529082.444970:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117181696 00000100:00100000:0.0:1782529082.445009:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782529082.445019:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3294:x1869117117181696:12345-0@lo:400: 00000100:00100000:0.0:1782529082.445089:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3294:x1869117117181696:12345-0@lo:400: Request processed in 70us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529082.445096:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782529082.445175:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117181696:0@lo:400: 00000100:00100000:3.0:1782529082.448352:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782529082.448385:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117181824:12345-0@lo:400: 00000100:00100000:3.0:1782529082.448482:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117181824:12345-0@lo:400: Request processed in 103us (4483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529082.448489:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782529082.448511:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782529082.448518:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117181952:12345-0@lo:400: 00000100:00100000:3.0:1782529082.453164:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117181952:12345-0@lo:400: Request processed in 4639us (9094us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529082.453177:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782529082.453444:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680008700 x1869117117181952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529082.453461:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117181952:0@lo:400: 00010000:00080000:0.0:1782529082.453475:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c68000b100 x1869117117181824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529082.453484:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117181824:0@lo:400: 00000001:02000400:2.0:1782529082.659146:0:6961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782529082.824118:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782529083.095783:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1782529083.859190:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529084.871141:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529085.896423:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529086.925714:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529087.559447:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117182208:0@lo:400: 00000100:00100000:3.0:1782529087.559556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529087.559640:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117182080:0@lo:400: 00000100:00100000:2.0:1782529087.560817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529087.560910:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117182592:0@lo:13: 00000100:00100000:2.0:1782529087.560959:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529087.561016:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117182080 00000100:00100000:2.0:1782529087.561023:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117182080 00000100:00100000:2.0:1782529087.561087:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782529087.561096:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3294:x1869117117182080:12345-0@lo:400: 00000100:00100000:2.0:1782529087.561150:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3294:x1869117117182080:12345-0@lo:400: Request processed in 54us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529087.561158:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782529087.561203:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117182592 00000100:00100000:2.0:1782529087.561207:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117182592 00000100:00100000:2.0:1782529087.561242:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529087.561249:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117182592:12345-0@lo:13: 00002000:00000024:2.0:1782529087.561284:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529087.561318:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117182592:12345-0@lo:13: Request processed in 70us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529087.561325:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529087.561367:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117182080:0@lo:400: 00010000:00080000:2.0:1782529087.561382:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f7100 x1869117117182592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529087.561393:0:3294:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782529087.561435:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117182592:0@lo:13: 00000100:00080000:2.0:1782529087.561456:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529087.562513:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117182336:0@lo:400: 00000100:00100000:3.0:1782529087.562564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529087.566123:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117182464:0@lo:400: 00000100:00100000:0.0:1782529087.566214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529087.566389:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117182464 00000100:00100000:0.0:1782529087.566398:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117182464 00000100:00100000:0.0:1782529087.566462:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782529087.566471:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117182464:12345-0@lo:400: 00000100:00100000:0.0:1782529087.566528:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117182464:12345-0@lo:400: Request processed in 58us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529087.566536:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782529087.566580:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cdfb80 x1869117117182464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529087.566820:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117182464:0@lo:400: 00000100:00100000:1.0:1782529087.574867:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117182208 00000100:00100000:1.0:1782529087.574886:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117182208 00000100:00100000:1.0:1782529087.574956:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117182336 00000100:00100000:1.0:1782529087.574959:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117182336 00000100:00080000:1.0:1782529087.574983:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529087.575011:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782529087.575022:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117182208:12345-0@lo:400: 00000100:00100000:2.0:1782529087.576088:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782529087.576105:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117182336:12345-0@lo:400: 00000100:00100000:1.0:1782529087.578919:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117182208:12345-0@lo:400: Request processed in 3888us (19351us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529087.578937:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782529087.579029:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cdea00 x1869117117182208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529087.579047:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117182208:0@lo:400: 00000100:00100000:2.0:1782529087.582419:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117182336:12345-0@lo:400: Request processed in 6309us (19843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529087.582436:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782529087.584168:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cddf80 x1869117117182336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529087.584192:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117182336:0@lo:400: 00010000:00010000:1.0:1782529087.945327:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529088.976875:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529089.999160:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529091.015982:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529092.040335:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529092.679266:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117182720:0@lo:400: 00000100:00100000:1.0:1782529092.679349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529092.679406:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782529092.679412:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117183104:0@lo:400: 00000100:00100000:1.0:1782529092.679435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529092.679464:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117183104 00000100:00100000:1.0:1782529092.679472:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117183104 00000100:00100000:1.0:1782529092.679524:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782529092.679532:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117183104:12345-0@lo:400: 00000100:00100000:1.0:1782529092.679581:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117183104:12345-0@lo:400: Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529092.679589:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1782529092.679624:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782529092.679652:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cdb800 x1869117117183104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529092.679667:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117183104:0@lo:400: 00000100:00100000:0.0:1782529092.679702:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117182848:0@lo:400: 00000100:00100000:0.0:1782529092.679737:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529092.679765:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782529092.679771:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117182976:0@lo:400: 00000100:00100000:0.0:1782529092.679812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529092.679864:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117182720 00000100:00100000:0.0:1782529092.679868:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117182720 00000100:00100000:0.0:1782529092.679897:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782529092.679903:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3295:x1869117117182720:12345-0@lo:400: 00000100:00100000:0.0:1782529092.679936:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3295:x1869117117182720:12345-0@lo:400: Request processed in 33us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529092.679942:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782529092.679972:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117182848 00000100:00100000:0.0:1782529092.679975:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117182848 00000100:00100000:3.0:1782529092.680273:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782529092.680284:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117183232:0@lo:13: 00000100:00100000:3.0:1782529092.680315:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529092.680450:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117183232 00000100:00100000:2.0:1782529092.680455:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117183232 00000100:00100000:2.0:1782529092.680495:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782529092.680504:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117183232:12345-0@lo:13: 00002000:00000024:2.0:1782529092.680532:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529092.680916:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117183232:12345-0@lo:13: Request processed in 413us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529092.680923:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782529092.683135:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117182976 00000100:00100000:0.0:1782529092.683149:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117182976 00010000:00080000:3.0:1782529092.685011:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680009880 x1869117117183232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529092.685052:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117183232:0@lo:13: 00000100:00100000:1.0:1782529092.685875:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782529092.685963:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782529092.685977:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117182976:12345-0@lo:400: 00000100:00100000:1.0:1782529092.686004:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117182848:12345-0@lo:400: 00000100:00100000:1.0:1782529092.692782:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117182848:12345-0@lo:400: Request processed in 6885us (13034us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529092.692799:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1782529092.692868:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cdad80 x1869117117182848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529092.692893:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117182848:0@lo:400: 00000100:00100000:2.0:1782529092.697899:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117182720:0@lo:400: 00000100:00080000:1.0:1782529092.698145:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529092.701940:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117182976:12345-0@lo:400: Request processed in 15962us (22120us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529092.701953:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1782529092.702149:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c680cd8000 x1869117117182976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529092.702177:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117182976:0@lo:400: 00010000:00010000:0.0:1782529093.069317:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529094.095751:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529095.110930:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782529095.276295:0:7490:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782529095.276297:0:7490:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1782529095.276417:0:7490:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99c67f60f000 00000020:01000004:3.0:1782529095.276429:0:7490:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782529095.276439:0:7490:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1782529095.276449:0:7490:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99c645a40000) 00000020:00000080:3.0:1782529095.276461:0:7490:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782529095.291855:0:7490:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782529095.292120:0:7490:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1782529095.313267:0:7490:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1782529095.319689:0:7490:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782529095.319725:0:7490:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1782529095.319783:0:7490:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782529095.319811:0:7490:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1782529095.320364:0:7490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782529095.320375:0:7490:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782529095.320384:0:7490:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bfdc08f7eab9fe 00000020:01000004:3.0:1782529095.320393:0:7490:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1782529095.320413:0:7490:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782529095.320416:0:7490:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782529095.320422:0:7490:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782529095.320443:0:7490:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1782529095.320446:0:7490:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782529095.344508:0:7490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782529095.344675:0:7490:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.150@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1782529095.344679:0:7490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782529095.344681:0:7490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782529095.344682:0:7490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529095.344689:0:7490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529095.344690:0:7490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529095.344691:0:7490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529095.344692:0:7490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529095.344694:0:7490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782529095.344695:0:7490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782529095.344697:0:7490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529095.344698:0:7490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782529095.344701:0:7490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1782529095.344703:0:7490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782529095.344704:0:7490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782529095.344705:0:7490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529095.344706:0:7490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529095.344707:0:7490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529095.344708:0:7490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529095.344708:0:7490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529095.344709:0:7490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782529095.344710:0:7490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782529095.344711:0:7490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529095.344712:0:7490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782529095.344739:0:7490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782529095.344760:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117183360:0@lo:253: 00000100:00100000:3.0:1782529095.344946:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.345161:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117183360 00000100:00100000:2.0:1782529095.345169:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117183360 00000100:00100000:2.0:1782529095.345263:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782529095.345274:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:7490:x1869117117183360:12345-0@lo:253: 20000000:01000000:2.0:1782529095.345485:0:5787:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782529095.345491:0:5787:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1782529095.345496:0:5787:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1782529095.345507:0:5787:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1782529095.347133:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782529095.347380:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1782529095.347395:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1782529095.347433:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1782529095.347441:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1782529095.347473:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1782529095.347517:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1782529095.348381:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1782529095.348401:0:5787:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:2.0:1782529095.348403:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1782529095.348439:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1782529095.348447:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782529095.348493:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1782529095.348501:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1782529095.348609:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1782529095.348622:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782529095.348661:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1782529095.348722:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1782529095.349827:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1782529095.349877:0:5787:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:2.0:1782529095.349879:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1782529095.349917:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1782529095.349925:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782529095.349958:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1782529095.349964:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1782529095.349992:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1782529095.350013:0:5787:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782529095.350063:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1782529095.350102:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1782529095.350119:0:5787:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1782529095.350129:0:5787:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1782529095.350135:0:5787:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782529095.350137:0:5787:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782529095.350139:0:5787:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782529095.350152:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782529095.350155:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1782529095.350189:0:5787:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782529095.350191:0:5787:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000100:00100000:3.0:1782529095.350613:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837eb40 going to sleep for 11 seconds 20000000:01000000:2.0:1782529095.351386:0:7492:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1782529095.351455:0:7492:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1782529095.351475:0:7492:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1782529095.351769:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1782529095.351793:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1782529095.351823:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1782529095.351844:0:5787:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782529095.351846:0:5787:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782529095.352416:0:7493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1782529095.352752:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1782529095.352789:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1782529095.353103:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1782529095.353118:0:5787:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782529095.353120:0:5787:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782529095.353694:0:7494:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1782529095.353746:0:7494:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1782529095.353812:0:7494:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1782529095.354497:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1782529095.354675:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1782529095.354763:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1782529095.354776:0:5787:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782529095.354778:0:5787:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782529095.355797:0:7495:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1782529095.356032:0:7495:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1782529095.356089:0:7495:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1782529095.356405:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1782529095.356448:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1782529095.356483:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:2.0:1782529095.356499:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782529095.356522:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.356749:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.356758:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.356779:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.356786:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.356792:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.356801:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.357046:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.357063:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 16 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.357079:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117183488:0@lo:104: 00000100:00100000:2.0:1782529095.357149:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782529095.357234:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.357243:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 16 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.357251:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117183616:0@lo:104: 00010000:00010000:2.0:1782529095.357275:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.357294:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 16 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.357301:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117183744:0@lo:104: 00010000:00010000:2.0:1782529095.357324:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.357332:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 16 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.357340:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117183872:0@lo:104: 00010000:00010000:2.0:1782529095.357361:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.357368:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 16 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.357376:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117184000:0@lo:104: 00000100:00100000:2.0:1782529095.357393:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646abd000 going to sleep for 11 seconds 00000100:00100000:0.0:1782529095.357437:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782529095.357456:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.357521:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.357695:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529095.357715:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117183488 00000100:00100000:1.0:1782529095.357723:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117183488 00000100:00100000:1.0:1782529095.357761:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117183616 00000100:00100000:1.0:1782529095.357763:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117183616 00000100:00100000:1.0:1782529095.357772:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117183744 00000100:00100000:1.0:1782529095.357774:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117183744 00000100:00100000:1.0:1782529095.357788:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782529095.357796:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+5:5787:x1869117117183488:12345-0@lo:104: 00010000:00010000:1.0:1782529095.357809:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.357954:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.357962:0:5777:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1782529095.357968:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1782529095.358237:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117183872 00000100:00100000:0.0:1782529095.358241:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117183872 00000100:00100000:0.0:1782529095.358259:0:5777:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1782529095.358264:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117184000 00000100:00100000:0.0:1782529095.358266:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117184000 00010000:00010000:1.0:1782529095.358495:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782529095.358503:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+7:5787:x1869117117183488:12345-0@lo:104: Request processed in 707us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.358510:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782529095.358580:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782529095.358587:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+6:5787:x1869117117183616:12345-0@lo:104: 00010000:00010000:1.0:1782529095.358596:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.358631:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782529095.358636:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+6:5787:x1869117117183616:12345-0@lo:104: Request processed in 50us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.358641:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782529095.358652:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782529095.358657:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+5:5787:x1869117117183744:12345-0@lo:104: 00010000:00010000:1.0:1782529095.358664:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.358704:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782529095.358709:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+5:5787:x1869117117183744:12345-0@lo:104: Request processed in 53us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.358715:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782529095.358727:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782529095.358733:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+4:5787:x1869117117183872:12345-0@lo:104: 00010000:00010000:1.0:1782529095.358740:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.358764:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782529095.358769:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+4:5787:x1869117117183872:12345-0@lo:104: Request processed in 37us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.358774:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782529095.358785:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782529095.358790:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5787:x1869117117184000:12345-0@lo:104: 00010000:00010000:1.0:1782529095.358796:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.358819:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1782529095.358825:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5787:x1869117117184000:12345-0@lo:104: Request processed in 35us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.358830:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1782529095.359281:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782529095.359289:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359296:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030a00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529095.359300:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359309:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529095.359316:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529095.359322:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529095.359509:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359524:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529095.359558:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359566:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eab9e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9f0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359580:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782529095.359583:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359589:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972a200 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529095.359592:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359598:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529095.359604:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529095.359610:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529095.359623:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359630:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529095.359635:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359641:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972a200/0x72bfdc08f7eab9bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359657:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782529095.359660:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359665:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045200 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529095.359668:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359674:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529095.359680:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529095.359686:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529095.359699:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359704:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529095.359719:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359726:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eab9a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359735:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782529095.359738:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359753:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529095.359756:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359761:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529095.359767:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529095.359771:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529095.359783:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359788:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529095.359793:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359798:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eab979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab980 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359807:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529095.359810:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359816:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972bc00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529095.359818:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359861:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529095.359868:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529095.359873:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529095.359888:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359893:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529095.359898:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359903:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eab94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab956 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.359917:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529095.359919:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529095.359921:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529095.359929:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529095.359945:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117184256:0@lo:103: 00000100:00100000:0.0:1782529095.360014:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.360054:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782529095.360060:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117184128:0@lo:103: 00000100:00100000:0.0:1782529095.360082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.360099:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117184640:0@lo:103: 00000100:00100000:0.0:1782529095.360118:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.360155:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117184384:0@lo:103: 00000100:00100000:0.0:1782529095.360177:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.360188:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529095.360194:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117184512:0@lo:103: 00000100:00100000:0.0:1782529095.360209:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.360232:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117184256 00000100:00100000:0.0:1782529095.360237:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117184256 00010000:00010000:0.0:1782529095.360262:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 17 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.360279:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117184128 00000100:00100000:0.0:1782529095.360282:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117184128 00010000:00010000:0.0:1782529095.360290:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 18 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.360299:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117184640 00000100:00100000:0.0:1782529095.360300:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117184640 00010000:00010000:0.0:1782529095.360309:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 19 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.360317:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117184384 00000100:00100000:0.0:1782529095.360319:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117184384 00010000:00010000:0.0:1782529095.360328:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 20 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.360336:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117184512 00000100:00100000:0.0:1782529095.360338:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117184512 00010000:00010000:0.0:1782529095.360348:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 21 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.360361:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782529095.360367:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+21:3297:x1869117117184256:12345-0@lo:103: 00010000:00010000:0.0:1782529095.360385:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529095.360391:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 21 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360401:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 21 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360418:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529095.360449:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+21:3297:x1869117117184256:12345-0@lo:103: Request processed in 82us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.360455:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782529095.360470:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782529095.360476:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+20:3297:x1869117117184128:12345-0@lo:103: 00010000:00010000:0.0:1782529095.360484:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529095.360488:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 20 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360496:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 20 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360504:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529095.360526:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+20:3297:x1869117117184128:12345-0@lo:103: Request processed in 50us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.360532:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782529095.360545:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782529095.360550:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117184640:12345-0@lo:103: 00010000:00010000:0.0:1782529095.360557:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529095.360561:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 19 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360572:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 19 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360580:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529095.360599:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117184640:12345-0@lo:103: Request processed in 49us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.360605:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782529095.360617:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782529095.360623:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:3294:x1869117117184384:12345-0@lo:103: 00010000:00010000:0.0:1782529095.360632:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529095.360636:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 18 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360644:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 18 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360652:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529095.360675:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:3294:x1869117117184384:12345-0@lo:103: Request processed in 53us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.360681:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782529095.360691:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782529095.360698:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:3294:x1869117117184512:12345-0@lo:103: 00010000:00010000:0.0:1782529095.360705:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529095.360709:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 17 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360717:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 17 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360735:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360743:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360758:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360765:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360771:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360778:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360783:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529095.360787:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360794:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360803:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.360814:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529095.360868:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:3294:x1869117117184512:12345-0@lo:103: Request processed in 169us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.360883:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782529095.360927:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117184512:0@lo:103: 00000100:00100000:0.0:1782529095.360934:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117184384:0@lo:103: 00000100:00100000:0.0:1782529095.360958:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117184128:0@lo:103: 00000100:00100000:0.0:1782529095.360964:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117184640:0@lo:103: 00000100:00100000:0.0:1782529095.360971:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117184256:0@lo:103: 00010000:00010000:2.0:1782529095.361435:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030000/0x72bfdc08f7eab9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab9e9 expref: 16 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.361447:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117183488:0@lo:104: 00010000:00010000:2.0:1782529095.361457:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a576400/0x72bfdc08f7eab9c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab9bf expref: 15 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.361466:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117183616:0@lo:104: 00010000:00010000:2.0:1782529095.361488:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eab9aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab9a3 expref: 14 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.361496:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117183744:0@lo:104: 00010000:00010000:2.0:1782529095.361504:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eab980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab979 expref: 13 pid: 5789 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.361510:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117183872:0@lo:104: 00010000:00010000:2.0:1782529095.361518:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030600/0x72bfdc08f7eab956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab94f expref: 12 pid: 5788 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.361525:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1869117117184000:0@lo:104: 00010000:00010000:2.0:1782529095.361647:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.361657:0:5787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.361663:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.361669:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782529095.361681:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1782529095.407156:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+11:7490:x1869117117183360:12345-0@lo:253: Request processed in 61875us (62201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529095.407173:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782529095.407285:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117183360:0@lo:253: 10000000:01000000:0.0:1782529095.407301:0:7490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782529095.407304:0:7490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782529095.407306:0:7490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782529095.407307:0:7490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782529095.407308:0:7490:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1782529095.407309:0:7490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782529095.407310:0:7490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782529095.407312:0:7490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782529095.407314:0:7490:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782529095.407316:0:7490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782529095.407317:0:7490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782529095.407337:0:7490:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99c67f60f000 from lustre-OST0001 10000000:01000000:0.0:1782529095.407365:0:7490:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782529095.407368:0:7490:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782529095.407376:0:7490:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99c6457b19c0 local copy 10000000:01000000:0.0:1782529095.407380:0:7490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782529095.407422:0:7490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.407433:0:7490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.407458:0:7490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.407478:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117184768:0@lo:101: 00000100:00100000:0.0:1782529095.407514:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.407563:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782529095.407718:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117184768 00000100:00100000:2.0:1782529095.407725:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117184768 00000100:00100000:2.0:1782529095.407772:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782529095.407782:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:7490:x1869117117184768:12345-0@lo:101: 00010000:00010000:2.0:1782529095.407805:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529095.407818:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaba0c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.407871:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba0c expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.407883:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba0c expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.407893:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045000, rc 0) 00000100:00100000:2.0:1782529095.407924:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117184768:12345-0@lo:101: Request processed in 144us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.407930:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782529095.408012:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117184768:0@lo:101: 00010000:00010000:3.0:1782529095.408026:0:7490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.408035:0:7490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529095.408154:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117184896:0@lo:501: 00000100:00100000:3.0:1782529095.408187:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529095.408215:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1782529095.408343:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117184896 00000100:00100000:2.0:1782529095.408348:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117184896 00000100:00100000:2.0:1782529095.408380:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782529095.408387:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117184896:12345-0@lo:501: 00000100:00100000:2.0:1782529095.408798:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117184896:12345-0@lo:501: Request processed in 410us (609us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782529095.408805:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782529095.408947:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117184896:0@lo:501: 10000000:01000000:3.0:1782529095.408961:0:7490:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782529095.408990:0:7490:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782529095.409006:0:7490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.409015:0:7490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.409023:0:7490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.409046:0:7490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782529095.409074:0:7490:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99c67f60f000 10000000:01000000:3.0:1782529095.409078:0:7490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782529095.409084:0:7490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782529095.409086:0:7490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782529095.409091:0:7490:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782529095.409094:0:7490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782529095.409115:0:7490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.409123:0:7490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.409132:0:7490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529095.409158:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185024:0@lo:101: 00000100:00100000:3.0:1782529095.409187:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529095.409218:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e540 going to sleep for 11 seconds 00010000:00010000:0.0:1782529095.409270:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529095.409277:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.409285:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030a00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529095.409288:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.409297:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529095.409304:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529095.409309:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529095.409329:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.409335:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529095.409364:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.409371:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eaba0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bfdc08f7eaba13 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.409390:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529095.409392:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529095.409393:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529095.409405:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117185152:0@lo:103: 00000100:00100000:0.0:1782529095.409435:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.409468:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117185152 00000100:00100000:0.0:1782529095.409472:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117185152 00000100:00100000:0.0:1782529095.409509:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782529095.409517:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:3297:x1869117117185152:12345-0@lo:103: 00010000:00010000:0.0:1782529095.409528:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529095.409556:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682045000/0x72bfdc08f7eaba13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eaba0c expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.409570:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529095.409598:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+11:3297:x1869117117185152:12345-0@lo:103: Request processed in 82us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.409732:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782529095.409770:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117185152:0@lo:103: 00000100:00100000:2.0:1782529095.409906:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117185024 00000100:00100000:2.0:1782529095.409910:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117185024 00000100:00100000:2.0:1782529095.409935:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782529095.409941:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+11:7490:x1869117117185024:12345-0@lo:101: 00010000:00010000:2.0:1782529095.409950:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529095.409961:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaba1a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.409990:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.410011:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.410017:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:2.0:1782529095.410045:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185024:12345-0@lo:101: Request processed in 104us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.410050:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782529095.410127:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185024:0@lo:101: 00010000:00010000:3.0:1782529095.410139:0:7490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.410147:0:7490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529095.410218:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185280:0@lo:501: 00000100:00100000:3.0:1782529095.410243:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529095.410266:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e540 going to sleep for 11 seconds 00000100:00100000:3.0:1782529095.410280:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117185280 00000100:00100000:3.0:1782529095.410283:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117185280 00000100:00100000:3.0:1782529095.410316:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782529095.410323:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185280:12345-0@lo:501: 00000100:00100000:3.0:1782529095.410530:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185280:12345-0@lo:501: Request processed in 206us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529095.410972:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782529095.411025:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185280:0@lo:501: 00000100:00100000:3.0:1782529095.411055:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185408:0@lo:503: 00000100:00100000:3.0:1782529095.411097:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529095.411159:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529095.411201:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117185408 00000100:00100000:0.0:1782529095.411205:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117185408 00000100:00100000:0.0:1782529095.411274:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782529095.411282:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185408:12345-0@lo:503: 00000100:00100000:0.0:1782529095.411438:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185408:12345-0@lo:503: Request processed in 157us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.411445:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782529095.411507:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185408:0@lo:503: 00000040:00080000:3.0:1782529095.411798:0:7490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782529095.411881:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185536:0@lo:502: 00000100:00100000:3.0:1782529095.411917:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529095.412451:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529095.412490:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117185536 00000100:00100000:2.0:1782529095.412495:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117185536 00000100:00100000:0.0:1782529095.412554:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782529095.412572:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185536:12345-0@lo:502: 00000100:00100000:0.0:1782529095.412747:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185536:12345-0@lo:502: Request processed in 178us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.412754:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782529095.412851:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185536:0@lo:502: 00000040:00080000:3.0:1782529095.413134:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782529095.413186:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782529095.413222:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782529095.413269:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782529095.413303:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782529095.413337:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782529095.413368:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185664:0@lo:502: 00000100:00100000:3.0:1782529095.413412:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529095.413939:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.414009:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117185664 00000100:00100000:1.0:1782529095.414016:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117185664 00000100:00100000:1.0:1782529095.414049:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782529095.414057:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185664:12345-0@lo:502: 00000100:00100000:1.0:1782529095.414305:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185664:12345-0@lo:502: Request processed in 249us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.414313:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782529095.414390:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185664:0@lo:502: 00000040:00080000:3.0:1782529095.414492:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782529095.414503:0:7490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1782529095.415279:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782529095.415288:0:7500:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1782529095.415294:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529095.415297:0:7500:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1782529095.415302:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782529095.415317:0:7500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99c67f364d40) 00000020:00000080:1.0:1782529095.415343:0:7500:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782529095.415350:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782529095.415414:0:7500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c67f60f000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1782529095.415422:0:7500:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782529095.415443:0:7500:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bfdc08f7eaba2f 00010000:00010000:1.0:1782529095.420401:0:7500:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1782529095.420890:0:7500:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1782529095.423278:0:7500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1782529095.423948:0:7500:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1782529095.429371:0:7500:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1782529095.430329:0:7500:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1782529095.432515:0:7500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782529095.432530:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529095.433737:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529095.433742:0:7500:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782529095.433751:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529095.433755:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529095.433756:0:7500:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782529095.433759:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782529095.433761:0:7500:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782529095.433809:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529095.433812:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529095.433822:0:7500:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782529095.433826:0:7500:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782529095.434297:0:7490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1782529095.434334:0:7490:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782529095.434359:0:7490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.434372:0:7490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529095.434381:0:7490:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c67f60f000 from 1 10000000:01000000:3.0:1782529095.434384:0:7490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782529095.434424:0:7490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.434439:0:7490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529095.434450:0:7490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529095.434473:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185792:0@lo:101: 00000100:00100000:3.0:1782529095.435100:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529095.435156:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529095.435244:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117185792 00000100:00100000:2.0:1782529095.435253:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117185792 00000100:00100000:2.0:1782529095.435308:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782529095.435318:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+12:7490:x1869117117185792:12345-0@lo:101: 00010000:00010000:2.0:1782529095.435333:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529095.435348:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaba36 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.435375:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.435386:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.435396:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045400, rc 0) 00000100:00100000:2.0:1782529095.435446:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117185792:12345-0@lo:101: Request processed in 130us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.435464:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782529095.435516:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185792:0@lo:101: 00010000:00010000:2.0:1782529095.435546:0:7490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.435556:0:7490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.435793:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185920:0@lo:501: 00000100:00100000:2.0:1782529095.435821:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.435873:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6456a2480 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.436017:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117185920 00000100:00100000:1.0:1782529095.436022:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117185920 00000100:00100000:1.0:1782529095.436048:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782529095.436054:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117185920:12345-0@lo:501: 00000100:00100000:1.0:1782529095.436288:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117185920:12345-0@lo:501: Request processed in 233us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.436295:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782529095.436534:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117185920:0@lo:501: 00000100:00100000:2.0:1782529095.436704:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186048:0@lo:503: 00000100:00100000:2.0:1782529095.436915:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.436944:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6456a2480 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.437586:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117186048 00000100:00100000:1.0:1782529095.437592:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117186048 00000100:00100000:1.0:1782529095.437630:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782529095.437635:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117186048:12345-0@lo:503: 00000100:00100000:1.0:1782529095.437954:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117186048:12345-0@lo:503: Request processed in 318us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.437959:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782529095.438270:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186048:0@lo:503: 00000040:00080000:2.0:1782529095.443295:0:7490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782529095.443401:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186176:0@lo:502: 00000100:00100000:2.0:1782529095.443496:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.443559:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8000 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.444909:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117186176 00000100:00100000:1.0:1782529095.444920:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117186176 00000100:00100000:1.0:1782529095.444971:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782529095.444981:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117186176:12345-0@lo:502: 00000100:00100000:1.0:1782529095.445284:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117186176:12345-0@lo:502: Request processed in 303us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.445293:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782529095.445444:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186176:0@lo:502: 00000040:00080000:3.0:1782529095.445916:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782529095.445972:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782529095.446018:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186304:0@lo:502: 00000100:00100000:3.0:1782529095.446064:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529095.446152:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e180 going to sleep for 11 seconds 00000100:00100000:2.0:1782529095.449102:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117186304 00000100:00100000:2.0:1782529095.449115:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117186304 00000100:00100000:3.0:1782529095.449271:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782529095.449283:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117186304:12345-0@lo:502: 00000100:00100000:3.0:1782529095.449553:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117186304:12345-0@lo:502: Request processed in 272us (3488us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529095.449561:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782529095.449661:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186304:0@lo:502: 00000040:00080000:2.0:1782529095.449812:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782529095.449827:0:7490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1782529095.450529:0:7504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529095.450548:0:7504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529095.450551:0:7504:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782529095.450557:0:7504:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c67f60f000 00000020:00000080:0.0:1782529095.450560:0:7504:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782529095.450580:0:7504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529095.450583:0:7504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529095.450584:0:7504:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782529095.450587:0:7504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782529095.450796:0:7490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782529095.450815:0:7490:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782529095.450864:0:7490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.450876:0:7490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529095.450917:0:7490:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782529095.450920:0:7490:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99c67f60f000 10000000:01000000:2.0:1782529095.450924:0:7490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99c67f60f000 10000000:01000000:2.0:1782529095.450928:0:7490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782529095.450933:0:7490:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c67f60f000 from 1 10000000:01000000:2.0:1782529095.450936:0:7490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782529095.450969:0:7490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.450977:0:7490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.450988:0:7490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.451016:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186432:0@lo:101: 00000100:00100000:2.0:1782529095.451067:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.451293:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8000 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.451352:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117186432 00000100:00100000:1.0:1782529095.451360:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117186432 00000100:00100000:1.0:1782529095.451396:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782529095.451404:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117186432:12345-0@lo:101: 00010000:00010000:1.0:1782529095.451418:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529095.451442:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaba44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.451469:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.451480:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.451490:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a576000, rc 0) 00000100:00100000:1.0:1782529095.451546:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186432:12345-0@lo:101: Request processed in 134us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.451553:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782529095.451746:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186432:0@lo:101: 00010000:00010000:2.0:1782529095.451760:0:7490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.451778:0:7490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529095.451893:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186560:0@lo:501: 00000100:00100000:2.0:1782529095.451920:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.451938:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8000 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.452017:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117186560 00000100:00100000:1.0:1782529095.452022:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117186560 00000100:00100000:1.0:1782529095.452038:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782529095.452042:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186560:12345-0@lo:501: 00000100:00100000:1.0:1782529095.452238:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186560:12345-0@lo:501: Request processed in 194us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.452246:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782529095.452316:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186560:0@lo:501: 00000100:00100000:2.0:1782529095.452343:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186688:0@lo:503: 00000100:00100000:2.0:1782529095.452378:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.452406:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8000 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.452450:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117186688 00000100:00100000:1.0:1782529095.452454:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117186688 00000100:00100000:1.0:1782529095.452471:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782529095.452477:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186688:12345-0@lo:503: 00000100:00100000:1.0:1782529095.452761:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186688:12345-0@lo:503: Request processed in 283us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.452767:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782529095.452869:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186688:0@lo:503: 00000040:00080000:2.0:1782529095.453131:0:7490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782529095.453204:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186816:0@lo:502: 00000100:00100000:2.0:1782529095.453238:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.453256:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8000 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.453340:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117186816 00000100:00100000:1.0:1782529095.453344:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117186816 00000100:00100000:1.0:1782529095.453370:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782529095.453375:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186816:12345-0@lo:502: 00000100:00100000:1.0:1782529095.453532:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186816:12345-0@lo:502: Request processed in 155us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.453673:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782529095.453759:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186816:0@lo:502: 00000040:00080000:2.0:1782529095.454063:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782529095.454111:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782529095.454143:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782529095.454185:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782529095.454223:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782529095.454279:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782529095.454318:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782529095.454354:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782529095.454402:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782529095.454437:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782529095.454482:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782529095.454534:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782529095.455190:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782529095.455222:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782529095.455271:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782529095.455308:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782529095.455343:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782529095.455390:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782529095.455425:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782529095.455730:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782529095.455780:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782529095.455812:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782529095.456225:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782529095.456283:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782529095.456319:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782529095.456353:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782529095.456419:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782529095.456461:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1782529095.456494:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1782529095.456695:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1782529095.456737:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1782529095.456768:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1782529095.456816:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1782529095.456898:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1782529095.456937:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1782529095.456988:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1782529095.457039:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1782529095.457087:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186944:0@lo:502: 00000100:00100000:2.0:1782529095.457160:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.457201:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8000 going to sleep for 11 seconds 00000100:00100000:1.0:1782529095.457327:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117186944 00000100:00100000:1.0:1782529095.457334:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117186944 00000100:00100000:1.0:1782529095.457386:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782529095.457395:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186944:12345-0@lo:502: 00000100:00100000:1.0:1782529095.457816:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117186944:12345-0@lo:502: Request processed in 421us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529095.457823:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782529095.457991:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117186944:0@lo:502: 00000040:00080000:2.0:1782529095.458087:0:7490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1782529095.458099:0:7490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1782529095.458762:0:7505:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1782529095.458778:0:7505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99c680cf19c0) 00000020:00000080:0.0:1782529095.458799:0:7505:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1782529095.459267:0:7505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c67f60f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782529095.459272:0:7505:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c67f60f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782529095.459275:0:7505:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c67f60f000 3 00010000:00080000:0.0:1782529095.459305:0:7505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c6783bc000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1782529095.462290:0:7505:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1782529095.462402:0:7505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782529095.462447:0:7505:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782529095.462462:0:7505:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72bfdc08f7eaba59 00000100:00080000:1.0:1782529095.462473:0:7505:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782529095.462479:0:7505:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99c6783bc000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529095.462515:0:7505:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c6457f5880 x1869117117187072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782529095.463053:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3293:1869117117187072:0@lo:38: 00000100:00100000:0.0:1782529095.463131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782529095.463327:0:7505:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782529095.463413:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117187200:0@lo:400: 00000100:00100000:1.0:1782529095.463441:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529095.463462:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529095.463467:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117187328:0@lo:400: 00000100:00100000:1.0:1782529095.463488:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529095.463513:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782529095.463531:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117187456:0@lo:400: 00000100:00100000:2.0:1782529095.463647:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117187072 00000100:00100000:2.0:1782529095.463654:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117187072 00000100:00100000:2.0:1782529095.463681:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117187200 00000100:00100000:2.0:1782529095.463683:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117187200 00000100:00100000:2.0:1782529095.463707:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117187328 00000100:00100000:2.0:1782529095.463710:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117187328 00000100:00100000:2.0:1782529095.463738:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782529095.463748:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117187200:12345-0@lo:400: 00000100:00100000:2.0:1782529095.463806:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117187200:12345-0@lo:400: Request processed in 59us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.463813:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782529095.463829:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782529095.463862:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117187328:12345-0@lo:400: 00000100:00100000:2.0:1782529095.463889:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117187328:12345-0@lo:400: Request processed in 30us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.463895:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782529095.463907:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782529095.463911:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3293:x1869117117187072:12345-0@lo:38: 00010000:00080000:2.0:1782529095.463931:0:6616:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1782529095.463962:0:6616:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72bfdc08f7eaba60 00000004:00100000:2.0:1782529095.463982:0:6616:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782529095.464031:0:6616:0:(import.c:65:import_set_state_nolock()) ffff99c6587e1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782529095.464085:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869117117187072:12345-0@lo:38: Request processed in 171us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.464091:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1782529095.464118:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782529095.464148:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f7800 x1869117117187328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529095.464163:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117187328:0@lo:400: 00010000:00080000:2.0:1782529095.464175:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f6d80 x1869117117187200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529095.464183:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117187200:0@lo:400: 00010000:00080000:2.0:1782529095.464219:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f5880 x1869117117187072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782529105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529095.464227:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782529095.464232:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1782529095.464239:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782529095.464244:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782529095.464246:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6783bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782529095.464251:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3293:1869117117187072:0@lo:38: 00000100:00100000:1.0:1782529095.464455:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.464822:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117187456 00000100:00100000:2.0:1782529095.464826:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117187456 00000100:00100000:2.0:1782529095.464895:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529095.464902:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117187456:12345-0@lo:400: 00000100:00100000:2.0:1782529095.464943:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117187456:12345-0@lo:400: Request processed in 43us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.464950:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1782529095.465124:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782529095.465145:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c6457f6680 x1869117117187456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529095.465156:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117187456:0@lo:400: 00000040:00080000:1.0:1782529095.465297:0:7505:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1782529095.465537:0:7506:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7506:1869117117187584:0@lo:901: 00000100:00100000:2.0:1782529095.465579:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529095.465629:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117187584 00000100:00100000:2.0:1782529095.465638:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117187584 00000100:00100000:2.0:1782529095.465678:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529095.465685:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7506:x1869117117187584:12345-0@lo:901: 00000100:00100000:2.0:1782529095.466072:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7506:x1869117117187584:12345-0@lo:901: Request processed in 387us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.466079:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529095.466104:0:7506:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8900 going to sleep for 11 seconds 00010000:00080000:2.0:1782529095.466122:0:7506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c68000a300 x1869117117187584/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782529111 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529095.466133:0:7506:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7506:1869117117187584:0@lo:901: 00000100:00080000:1.0:1782529095.466429:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1782529095.471923:0:7490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1782529095.471972:0:7490:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782529095.471993:0:7490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.472018:0:7490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782529095.473764:0:7490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782529095.473767:0:7490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782529095.473768:0:7490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782529095.473769:0:7490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782529095.473770:0:7490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782529095.473772:0:7490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782529095.473773:0:7490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782529095.473775:0:7490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782529095.473776:0:7490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782529095.473777:0:7490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782529095.473778:0:7490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782529095.473782:0:7490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1782529095.473783:0:7490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782529095.473784:0:7490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782529095.473785:0:7490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782529095.473785:0:7490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782529095.473786:0:7490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782529095.473787:0:7490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782529095.473787:0:7490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782529095.473788:0:7490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782529095.473789:0:7490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782529095.473790:0:7490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782529095.473790:0:7490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782529095.473827:0:7490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782529095.473869:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117187712:0@lo:253: 00000100:00100000:0.0:1782529095.473946:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.473985:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529095.474061:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117187712 00000100:00100000:3.0:1782529095.474069:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117187712 00000100:00100000:3.0:1782529095.474127:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782529095.474139:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7490:x1869117117187712:12345-0@lo:253: 20000000:01000000:3.0:1782529095.474167:0:5789:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782529095.474180:0:5789:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782529095.516250:0:5789:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782529095.516272:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1782529095.516376:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782529095.516381:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782529095.516405:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.516424:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.516434:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.516475:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529095.516490:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 14 pid: 5787 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529095.516505:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869117117187840:0@lo:104: 00000100:00100000:1.0:1782529095.516757:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529095.516872:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6806cecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529095.518812:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117187840 00000100:00100000:2.0:1782529095.518825:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117187840 00000100:00100000:2.0:1782529095.518897:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782529095.518908:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5810:x1869117117187840:12345-0@lo:104: 00010000:00010000:2.0:1782529095.518925:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529095.519018:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529095.519024:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:5810:x1869117117187840:12345-0@lo:104: Request processed in 119us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529095.519031:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1782529095.519155:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529095.519162:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.519170:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044e00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529095.519175:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.519201:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529095.519209:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529095.519214:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782529095.519260:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.519266:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529095.519285:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.519291:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682044e00/0x72bfdc08f7eab9b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab9b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.519308:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529095.519310:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529095.519312:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529095.519897:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117187968:0@lo:103: 00000100:00100000:0.0:1782529095.519941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529095.520015:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869117117187840:0@lo:104: 00010000:00010000:0.0:1782529095.520037:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.520059:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117187968 00000100:00100000:0.0:1782529095.520063:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117187968 00010000:00010000:0.0:1782529095.520084:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 15 pid: 5787 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.520118:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782529095.520125:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650286850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:3297:x1869117117187968:12345-0@lo:103: 00010000:00010000:0.0:1782529095.520137:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529095.520143:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 15 pid: 5787 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520154:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 15 pid: 5787 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520167:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640031000/0x72bfdc08f7eab9b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab9b1 expref: 15 pid: 5787 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520183:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520191:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782529095.520206:0:5780:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003826432s 00010000:00010000:0.0:1782529095.520210:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520217:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520224:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520230:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520243:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529095.520248:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520255:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520269:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520278:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529095.520307:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650286850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:3297:x1869117117187968:12345-0@lo:103: Request processed in 183us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529095.520314:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1782529095.520357:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520365:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529095.520371:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eaba67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529095.520396:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117187968:0@lo:103: 00000100:00100000:3.0:1782529095.527973:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:7490:x1869117117187712:12345-0@lo:253: Request processed in 53825us (54015us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529095.527990:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782529095.528210:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:adf301ee-99ae-4756-993e-d61f1989f0b8:7490:1869117117187712:0@lo:253: 10000000:01000000:0.0:1782529095.528227:0:7490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782529095.528230:0:7490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782529095.528232:0:7490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782529095.528247:0:7490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782529095.528248:0:7490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782529095.528249:0:7490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782529095.528251:0:7490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782529095.528252:0:7490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782529095.528254:0:7490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782529095.528255:0:7490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782529095.528257:0:7490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782529095.528259:0:7490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782529095.528275:0:7490:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1782529095.534215:0:7490:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1782529095.534398:0:7490:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1782529095.534765:0:7490:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1782529095.535110:0:7490:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1782529095.535295:0:7490:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1782529095.536278:0:7490:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1782529095.537481:0:7490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782529095.721300:0:7490:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782529095.721307:0:7490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782529095.721350:0:7490:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782529095.721408:0:7490:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782529095.721423:0:7490:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782529095.721439:0:7490:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1782529096.136140:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529097.159460:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529097.799266:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529097.799295:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117188096:0@lo:13: 00000100:00100000:0.0:1782529097.799371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529097.799650:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117188096 00000100:00100000:3.0:1782529097.799659:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117188096 00000100:00100000:3.0:1782529097.799727:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782529097.799737:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117188096:12345-0@lo:13: 00002000:00000024:3.0:1782529097.799781:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529097.799865:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117188096:12345-0@lo:13: Request processed in 130us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529097.799873:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782529097.799931:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782529097.800006:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000a300 x1869117117188096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529097.800023:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117188096:0@lo:13: 00010000:00010000:1.0:1782529098.183994:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529099.207054:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529100.231056:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529100.874486:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117188608:0@lo:400: 00000100:00100000:2.0:1782529100.874536:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117188352:0@lo:400: 00000100:00100000:2.0:1782529100.874637:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529100.874700:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117188480:0@lo:400: 00000100:00100000:2.0:1782529100.874738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529100.874808:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117188352 00000100:00100000:2.0:1782529100.874815:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117188352 00000100:00100000:2.0:1782529100.874876:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117188480 00000100:00100000:2.0:1782529100.874879:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117188480 00000100:00100000:2.0:1782529100.874909:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782529100.874917:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117188352:12345-0@lo:400: 00000100:00100000:3.0:1782529100.876123:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117188224:0@lo:400: 00000100:00100000:3.0:1782529100.876181:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529100.876213:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117188736:0@lo:400: 00000100:00100000:3.0:1782529100.876241:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529100.876461:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117188224 00000100:00100000:1.0:1782529100.876467:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117188224 00000100:00100000:1.0:1782529100.876512:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782529100.876521:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3295:x1869117117188224:12345-0@lo:400: 00000100:00100000:1.0:1782529100.876579:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3295:x1869117117188224:12345-0@lo:400: Request processed in 60us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529100.876586:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782529100.876633:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117188224:0@lo:400: 00000100:00100000:2.0:1782529100.876750:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117188352:12345-0@lo:400: Request processed in 1834us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529100.876757:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782529100.876770:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117188736 00000100:00100000:2.0:1782529100.876773:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117188736 00000100:00100000:2.0:1782529100.876796:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782529100.876802:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117188480:12345-0@lo:400: 00000100:00100000:2.0:1782529100.876855:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117188480:12345-0@lo:400: Request processed in 52us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529100.876861:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782529100.876873:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529100.876880:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117188736:12345-0@lo:400: 00000100:00080000:3.0:1782529100.877890:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529100.878010:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782529100.878146:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680008380 x1869117117188352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529100.878161:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117188352:0@lo:400: 00000100:00100000:2.0:1782529100.878313:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117188736:12345-0@lo:400: Request processed in 40us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529100.878322:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1782529100.878588:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000aa00 x1869117117188480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529100.878599:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117188480:0@lo:400: 00010000:00080000:1.0:1782529100.878688:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000b480 x1869117117188736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529100.878698:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117188736:0@lo:400: 00000100:00100000:1.0:1782529100.878727:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117188608 00000100:00100000:1.0:1782529100.878732:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117188608 00000100:00100000:1.0:1782529100.878775:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529100.878782:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117188608:12345-0@lo:400: 00000100:00100000:1.0:1782529100.878829:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117188608:12345-0@lo:400: Request processed in 47us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529100.878859:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782529100.878884:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000bb80 x1869117117188608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529100.878893:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117188608:0@lo:400: 00000100:00080000:2.0:1782529100.879643:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782529101.255013:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529102.284968:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782529102.816973:0:7848:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1782529102.919253:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782529102.919284:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117188864:0@lo:13: 00000100:00100000:0.0:1782529102.919358:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529102.919514:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117188864 00000100:00100000:2.0:1782529102.919534:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117188864 00000100:00100000:2.0:1782529102.919615:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782529102.919625:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117188864:12345-0@lo:13: 00002000:00000024:2.0:1782529102.919661:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529102.919713:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117188864:12345-0@lo:13: Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529102.919720:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782529102.919760:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000aa00 x1869117117188864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529102.919779:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117188864:0@lo:13: 00000100:00080000:3.0:1782529102.919899:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782529103.303057:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529104.328539:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782529104.968330:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782529104.968340:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c6795ce000 from 30 10000000:01000000:2.0:1782529104.968347:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782529104.968410:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529104.968425:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529104.968437:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529104.968463:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117188992:0@lo:101: 00000100:00100000:2.0:1782529104.968549:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529104.968622:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529104.968725:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117188992 00000100:00100000:0.0:1782529104.968749:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117188992 00000100:00100000:0.0:1782529104.968817:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782529104.968828:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117188992:12345-0@lo:101: 00010000:00010000:0.0:1782529104.968868:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529104.968894:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaba6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529104.968955:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529104.968967:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529104.968978:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030000, rc 0) 00000100:00100000:0.0:1782529104.969050:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117188992:12345-0@lo:101: Request processed in 210us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529104.969057:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782529104.969124:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117188992:0@lo:101: 00010000:00010000:3.0:1782529104.969140:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529104.969154:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529104.969213:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cde300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189120:0@lo:501: 00000100:00100000:3.0:1782529104.969239:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529104.969272:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529104.969351:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117189120 00000100:00100000:1.0:1782529104.969357:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117189120 00000100:00100000:1.0:1782529104.969390:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782529104.969396:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117189120:12345-0@lo:501: 00000100:00100000:1.0:1782529104.969755:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117189120:12345-0@lo:501: Request processed in 358us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529104.969762:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782529104.969796:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cde300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189120:0@lo:501: 00000100:00100000:1.0:1782529104.969829:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189248:0@lo:503: 00000100:00100000:1.0:1782529104.969924:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529104.969951:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529104.970676:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117189248 00000100:00100000:0.0:1782529104.970684:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117189248 00000100:00100000:0.0:1782529104.970739:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782529104.970747:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117189248:12345-0@lo:503: 00000100:00100000:0.0:1782529104.971176:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117189248:12345-0@lo:503: Request processed in 428us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529104.971184:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782529104.971205:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189248:0@lo:503: 00000100:00100000:1.0:1782529104.971560:0:7952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7952:1869117117189376:0@lo:502: 00000100:00100000:1.0:1782529104.971601:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529104.971635:0:7952:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7000 going to sleep for 11 seconds 00000100:00100000:2.0:1782529104.971686:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117189376 00000100:00100000:2.0:1782529104.971691:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117189376 00000100:00100000:2.0:1782529104.971725:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782529104.971732:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7952:x1869117117189376:12345-0@lo:502: 00000100:00100000:2.0:1782529104.972240:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7952:x1869117117189376:12345-0@lo:502: Request processed in 508us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529104.972248:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782529104.977459:0:7952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7952:1869117117189376:0@lo:502: 00000100:00100000:1.0:1782529104.977573:0:7952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7952:1869117117189504:0@lo:502: 00000100:00100000:1.0:1782529104.977649:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529104.977853:0:7952:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7000 going to sleep for 11 seconds 00000100:00100000:2.0:1782529104.979034:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117189504 00000100:00100000:2.0:1782529104.979055:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117189504 00000100:00100000:2.0:1782529104.979128:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782529104.979139:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7952:x1869117117189504:12345-0@lo:502: 00000100:00100000:2.0:1782529104.979432:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:7952:x1869117117189504:12345-0@lo:502: Request processed in 294us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529104.979440:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782529104.980595:0:7952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7952:1869117117189504:0@lo:502: 00000040:00080000:1.0:1782529104.980640:0:7952:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1782529104.981781:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1782529104.981967:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782529104.981982:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529104.981994:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529104.982005:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782529104.982008:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1782529104.982010:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782529104.982117:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529104.982127:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529104.982139:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529104.982178:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189632:0@lo:101: 00000100:00100000:2.0:1782529104.982244:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529104.982281:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601840 going to sleep for 11 seconds 00000100:00100000:0.0:1782529104.982540:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117189632 00000100:00100000:0.0:1782529104.982550:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117189632 00000100:00100000:0.0:1782529104.982604:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782529104.982613:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117189632:12345-0@lo:101: 00010000:00010000:0.0:1782529104.982628:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529104.982648:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaba7c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529104.982675:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529104.982686:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529104.982695:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030600, rc 0) 00000100:00100000:0.0:1782529104.982884:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117189632:12345-0@lo:101: Request processed in 271us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529104.983030:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189632:0@lo:101: 00000100:00100000:0.0:1782529104.983284:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:2.0:1782529104.983358:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529104.983369:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529104.983432:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189760:0@lo:501: 00000100:00100000:2.0:1782529104.983465:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529104.983542:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601840 going to sleep for 11 seconds 00000100:00100000:3.0:1782529104.988423:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117189760 00000100:00100000:3.0:1782529104.988439:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117189760 00000100:00100000:3.0:1782529104.988597:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782529104.988609:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117189760:12345-0@lo:501: 00000100:00100000:3.0:1782529104.989118:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117189760:12345-0@lo:501: Request processed in 510us (5650us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529104.989127:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782529104.989231:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189760:0@lo:501: 00000100:00100000:2.0:1782529104.989286:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189888:0@lo:503: 00000100:00100000:2.0:1782529104.989334:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529104.996552:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601840 going to sleep for 11 seconds 00000100:00100000:1.0:1782529105.004314:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117189888 00000100:00100000:1.0:1782529105.004331:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117189888 00000100:00100000:1.0:1782529105.004409:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782529105.004419:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117189888:12345-0@lo:503: 00000100:00100000:1.0:1782529105.005223:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117189888:12345-0@lo:503: Request processed in 803us (15885us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529105.005232:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782529105.008827:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117189888:0@lo:503: 00000100:00100000:0.0:1782529105.010142:0:7953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7953:1869117117190016:0@lo:502: 00000100:00100000:0.0:1782529105.010232:0:7953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.010276:0:7953:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646ad6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782529105.010328:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117190016 00000100:00100000:1.0:1782529105.010336:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117190016 00000100:00100000:1.0:1782529105.010387:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782529105.010397:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:7953:x1869117117190016:12345-0@lo:502: 00000100:00100000:1.0:1782529105.010923:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:7953:x1869117117190016:12345-0@lo:502: Request processed in 516us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529105.010933:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782529105.011108:0:7953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7953:1869117117190016:0@lo:502: 00000020:01000000:0.0:1782529105.011139:0:7953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529105.011150:0:7953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529105.011152:0:7953:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782529105.011156:0:7953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782529105.011158:0:7953:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782529105.011176:0:7953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7953:1869117117190144:0@lo:502: 00000100:00100000:0.0:1782529105.011212:0:7953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.011248:0:7953:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642e9b180 going to sleep for 11 seconds 00000100:00100000:3.0:1782529105.011302:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117190144 00000100:00100000:3.0:1782529105.011307:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117190144 00000100:00100000:3.0:1782529105.011342:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782529105.011349:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:7953:x1869117117190144:12345-0@lo:502: 00000100:00100000:3.0:1782529105.011501:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:7953:x1869117117190144:12345-0@lo:502: Request processed in 151us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529105.011508:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782529105.011727:0:7953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7953:1869117117190144:0@lo:502: 00000020:01000000:0.0:1782529105.011748:0:7953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529105.011758:0:7953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529105.011759:0:7953:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782529105.011763:0:7953:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1782529105.012108:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1782529105.012134:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782529105.012146:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.012157:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529105.012174:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782529105.012177:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c646a6f800 from 30 10000000:01000000:3.0:1782529105.012179:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782529105.012210:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.012219:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.012229:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529105.012244:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117190272:0@lo:101: 00000100:00100000:3.0:1782529105.012278:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529105.012313:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529105.012815:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117190272 00000100:00100000:1.0:1782529105.012822:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117190272 00000100:00100000:1.0:1782529105.012879:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782529105.012888:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117190272:12345-0@lo:101: 00010000:00010000:1.0:1782529105.012900:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529105.012926:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaba8a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529105.012954:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529105.012966:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529105.012977:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a577400, rc 0) 00000100:00100000:1.0:1782529105.013017:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117190272:12345-0@lo:101: Request processed in 131us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529105.013035:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782529105.013177:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117190272:0@lo:101: 00010000:00010000:3.0:1782529105.013194:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.013203:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529105.013254:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117190400:0@lo:501: 00000100:00100000:3.0:1782529105.013282:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529105.013311:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529105.013380:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117190400 00000100:00100000:0.0:1782529105.013385:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117190400 00000100:00100000:0.0:1782529105.013418:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782529105.013425:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117190400:12345-0@lo:501: 00000100:00100000:0.0:1782529105.013890:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117190400:12345-0@lo:501: Request processed in 464us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.013898:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782529105.013949:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117190400:0@lo:501: 00000100:00100000:0.0:1782529105.013981:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117190528:0@lo:503: 00000100:00100000:0.0:1782529105.014018:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.014032:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642e9b000 going to sleep for 11 seconds 00000100:00100000:3.0:1782529105.014183:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117190528 00000100:00100000:3.0:1782529105.014188:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117190528 00000100:00100000:3.0:1782529105.014209:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782529105.014221:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117190528:12345-0@lo:503: 00000100:00100000:3.0:1782529105.014355:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117190528:12345-0@lo:503: Request processed in 134us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529105.014361:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782529105.015476:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117190528:0@lo:503: 00000100:00100000:0.0:1782529105.038477:0:7954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7954:1869117117190656:0@lo:502: 00000100:00100000:0.0:1782529105.038583:0:7954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.038628:0:7954:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642e9bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529105.038795:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117190656 00000100:00100000:3.0:1782529105.038803:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117190656 00000100:00100000:3.0:1782529105.038887:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782529105.038898:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:7954:x1869117117190656:12345-0@lo:502: 00000100:00100000:3.0:1782529105.039188:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:7954:x1869117117190656:12345-0@lo:502: Request processed in 291us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529105.039198:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782529105.039312:0:7954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7954:1869117117190656:0@lo:502: 00000100:00100000:2.0:1782529105.039369:0:7954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680009180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7954:1869117117190784:0@lo:502: 00000100:00100000:2.0:1782529105.039407:0:7954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529105.039442:0:7954:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601840 going to sleep for 11 seconds 00000100:00100000:0.0:1782529105.039520:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117190784 00000100:00100000:0.0:1782529105.039524:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117190784 00000100:00100000:0.0:1782529105.039548:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782529105.039555:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:7954:x1869117117190784:12345-0@lo:502: 00000100:00100000:0.0:1782529105.039694:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:7954:x1869117117190784:12345-0@lo:502: Request processed in 139us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.039714:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782529105.039793:0:7954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680009180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7954:1869117117190784:0@lo:502: 00000040:00080000:2.0:1782529105.039814:0:7954:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782529105.040288:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782529105.040312:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782529105.040331:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.040342:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529105.040351:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782529105.040353:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff99c646a6f800 from 5 10000000:01000000:0.0:1782529105.040356:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782529105.040387:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.040395:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.040404:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529105.040418:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117190912:0@lo:101: 00000100:00100000:0.0:1782529105.040455:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.040498:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642e9bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782529105.040546:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117190912 00000100:00100000:2.0:1782529105.040558:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117190912 00000100:00100000:2.0:1782529105.040594:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782529105.040601:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117190912:12345-0@lo:101: 00010000:00010000:2.0:1782529105.040611:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529105.040626:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044e00/0x72bfdc08f7eaba9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaba98 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529105.040650:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044e00/0x72bfdc08f7eaba9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba98 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529105.040660:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044e00/0x72bfdc08f7eaba9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba98 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529105.040670:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044e00, rc 0) 00000100:00100000:2.0:1782529105.040711:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117190912:12345-0@lo:101: Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529105.040717:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782529105.040951:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117190912:0@lo:101: 00010000:00010000:0.0:1782529105.040965:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.040974:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529105.041021:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117191040:0@lo:256: 00000100:00100000:0.0:1782529105.041060:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.041088:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642e9bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782529105.041102:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117191040 00000100:00100000:0.0:1782529105.041105:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117191040 00000100:00100000:0.0:1782529105.041126:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782529105.041133:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117191040:12345-0@lo:256: 20000000:01000000:0.0:1782529105.041146:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782529105.041162:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782529105.041166:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1782529105.041239:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117191040:12345-0@lo:256: Request processed in 106us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.041245:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782529105.041273:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117191040:0@lo:256: 10000000:01000000:0.0:1782529105.041307:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782529105.041312:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.041320:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529105.041327:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782529105.041328:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1782529105.041331:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782529105.041345:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.041352:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.041368:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529105.041378:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117191168:0@lo:101: 00000100:00100000:0.0:1782529105.041401:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.041413:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642e9bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782529105.041423:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117191168 00000100:00100000:0.0:1782529105.041426:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117191168 00000100:00100000:0.0:1782529105.041441:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782529105.041446:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117191168:12345-0@lo:101: 00010000:00010000:0.0:1782529105.041452:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529105.041461:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabaa6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.041476:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.041632:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529105.041639:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031c00, rc 0) 00000100:00100000:0.0:1782529105.041714:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117191168:12345-0@lo:101: Request processed in 267us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.041720:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782529105.048626:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117191168:0@lo:101: 00010000:00010000:2.0:1782529105.048661:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529105.048676:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529105.049000:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680009180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117191296:0@lo:501: 00000100:00100000:2.0:1782529105.049579:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529105.049628:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529105.049682:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117191296 00000100:00100000:0.0:1782529105.049689:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117191296 00000100:00100000:0.0:1782529105.049936:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782529105.049947:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117191296:12345-0@lo:501: 00000100:00100000:2.0:1782529105.050451:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117191296:12345-0@lo:501: Request processed in 505us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529105.050468:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782529105.050554:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680009180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117191296:0@lo:501: 00000100:00100000:0.0:1782529105.050594:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117191424:0@lo:503: 00000100:00100000:0.0:1782529105.050637:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.058202:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6603de480 going to sleep for 11 seconds 00000100:00100000:3.0:1782529105.058801:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117191424 00000100:00100000:3.0:1782529105.058812:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117191424 00000100:00100000:3.0:1782529105.059267:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782529105.059277:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117191424:12345-0@lo:503: 00000100:00100000:3.0:1782529105.059693:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117191424:12345-0@lo:503: Request processed in 415us (9053us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.060103:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117191424:0@lo:503: 00000100:00100000:3.0:1782529105.060388:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782529105.063995:0:7955:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7955:1869117117191552:0@lo:502: 00000100:00100000:2.0:1782529105.064101:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529105.064137:0:7955:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648547480 going to sleep for 11 seconds 00000100:00100000:3.0:1782529105.064248:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117191552 00000100:00100000:3.0:1782529105.064255:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117191552 00000100:00100000:3.0:1782529105.064302:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782529105.064311:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:7955:x1869117117191552:12345-0@lo:502: 00000100:00100000:3.0:1782529105.064637:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:7955:x1869117117191552:12345-0@lo:502: Request processed in 325us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529105.064646:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782529105.064895:0:7955:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7955:1869117117191552:0@lo:502: 00000020:01000000:0.0:1782529105.064951:0:7955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782529105.064959:0:7955:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1782529105.064966:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529105.064968:0:7955:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1782529105.064973:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782529105.064977:0:7955:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:0.0:1782529105.064996:0:7955:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1782529105.064999:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782529105.065012:0:7955:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99c680cf3380) 00000020:00000080:0.0:1782529105.065031:0:7955:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1782529105.065051:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782529105.065121:0:7955:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1782529105.065127:0:7955:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1782529105.065133:0:7955:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eababb 00010000:00080000:0.0:1782529105.065164:0:7955:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c6783bc800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:0.0:1782529105.065389:0:7955:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1782529105.065715:0:7955:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1782529105.065727:0:7955:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1782529105.066274:0:7955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782529105.066484:0:7955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782529105.066537:0:7955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1782529105.066619:0:7955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1782529105.067672:0:7956:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529105.067678:0:7956:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1782529105.079083:0:7955:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782529105.079101:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782529105.079142:0:7955:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782529105.079163:0:7955:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eabac2 00000100:00080000:3.0:1782529105.079175:0:7955:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782529105.079181:0:7955:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99c6783bc800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1782529105.079219:0:7955:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c680cdd180 x1869117117191680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782529105.079244:0:7955:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1782529105.079369:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117191680:0@lo:8: 00000100:00100000:2.0:1782529105.079441:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529105.079585:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117191680 00000100:00100000:1.0:1782529105.079592:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117191680 00000100:00100000:1.0:1782529105.079629:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782529105.079636:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3293:x1869117117191680:12345-0@lo:8: 00010000:00080000:1.0:1782529105.079663:0:6593:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:1.0:1782529105.079693:0:6593:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eabac9 00002000:00100000:1.0:1782529105.079720:0:6593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99c677942800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113663 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1782529105.079725:0:6593:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1782529105.079729:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782529105.079873:0:6593:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782529105.080028:0:6593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782529105.080055:0:6593:0:(import.c:65:import_set_state_nolock()) ffff99c677947000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529105.080112:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1869117117191680:12345-0@lo:8: Request processed in 474us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529105.080120:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782529105.080381:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdd180 x1869117117191680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782529115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529105.080393:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782529105.080401:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782529105.080408:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782529105.080412:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782529105.080414:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6783bc800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782529105.085595:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117192192:0@lo:400: 00000100:00100000:0.0:1782529105.085667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.085719:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782529105.085725:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117191808:0@lo:400: 00000100:00100000:0.0:1782529105.085749:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.085776:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117191936:0@lo:400: 00000100:00100000:0.0:1782529105.085799:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.085822:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529105.085827:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117192064:0@lo:400: 00000100:00100000:0.0:1782529105.085867:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.085901:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117192192 00000100:00100000:0.0:1782529105.085908:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117192192 00000100:00100000:0.0:1782529105.085980:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117191808 00000100:00100000:0.0:1782529105.085984:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117191808 00000100:00100000:0.0:1782529105.085995:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117191936 00000100:00100000:0.0:1782529105.085997:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117191936 00000100:00100000:0.0:1782529105.086013:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782529105.086021:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117192192:12345-0@lo:400: 00000100:00100000:0.0:1782529105.086097:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117192192:12345-0@lo:400: Request processed in 75us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.086106:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782529105.086126:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782529105.086132:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117191808:12345-0@lo:400: 00000100:00100000:0.0:1782529105.086159:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117191808:12345-0@lo:400: Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.086165:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782529105.086176:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782529105.086198:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117191936:12345-0@lo:400: 00000100:00100000:0.0:1782529105.086230:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117191936:12345-0@lo:400: Request processed in 34us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.086237:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1782529105.086256:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782529105.086285:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b0a680 x1869117117191936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529105.086299:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117191936:0@lo:400: 00010000:00080000:0.0:1782529105.086330:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b0b100 x1869117117191808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529105.086338:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117191808:0@lo:400: 00010000:00080000:0.0:1782529105.086346:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b09f80 x1869117117192192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529105.086354:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117192192:0@lo:400: 00000004:00080000:2.0:1782529105.089462:0:3293:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782529105.089492:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117191680:0@lo:8: 00000100:00100000:2.0:1782529105.089561:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117192064 00000100:00100000:2.0:1782529105.089569:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117192064 00000100:00100000:2.0:1782529105.089641:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782529105.089650:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117192064:12345-0@lo:400: 00000100:00100000:2.0:1782529105.089756:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117192064:12345-0@lo:400: Request processed in 106us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529105.089764:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782529105.091488:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b08a80 x1869117117192064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529105.091509:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117192064:0@lo:400: 00000100:00080000:1.0:1782529105.092062:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1782529105.092181:0:7956:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782529105.092435:0:7956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167004600854ns, next at 0ns, rc = 0 00000020:01000000:3.0:1782529105.097890:0:7955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529105.097903:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529105.097906:0:7955:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1782529105.097909:0:7955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529105.097923:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529105.097924:0:7955:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782529105.097928:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782529105.097930:0:7955:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782529105.097977:0:7955:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7955:1869117117192320:0@lo:502: 00000100:00100000:3.0:1782529105.098301:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529105.098351:0:7955:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529105.098432:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117192320 00000100:00100000:0.0:1782529105.098441:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117192320 00000100:00100000:0.0:1782529105.098504:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782529105.098514:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:7955:x1869117117192320:12345-0@lo:502: 00000100:00100000:0.0:1782529105.098928:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:7955:x1869117117192320:12345-0@lo:502: Request processed in 414us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529105.098937:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782529105.100377:0:7955:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:7955:1869117117192320:0@lo:502: 00000020:01000000:3.0:1782529105.100419:0:7955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529105.100427:0:7955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529105.100430:0:7955:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782529105.100435:0:7955:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1782529105.100524:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782529105.100541:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782529105.100553:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.100579:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529105.100590:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782529105.100593:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff99c6457b19c0 from 1 10000000:01000000:3.0:1782529105.100596:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782529105.100629:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.100637:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.100646:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529105.100663:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117192448:0@lo:101: 00000100:00100000:3.0:1782529105.102189:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529105.102244:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c649ea4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529105.103669:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117192448 00000100:00100000:3.0:1782529105.103681:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117192448 00000100:00100000:3.0:1782529105.103751:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782529105.103763:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117192448:12345-0@lo:101: 00010000:00010000:3.0:1782529105.103785:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529105.103811:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabad0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.103861:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.103892:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.103904:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972a200, rc 0) 00000100:00100000:3.0:1782529105.103980:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117192448:12345-0@lo:101: Request processed in 219us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529105.103987:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782529105.104059:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117192448:0@lo:101: 00010000:00010000:3.0:1782529105.104078:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.104087:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529105.104155:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117192576:0@lo:501: 00000100:00100000:3.0:1782529105.104186:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529105.104211:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c649ea4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529105.104224:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117192576 00000100:00100000:3.0:1782529105.104227:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117192576 00000100:00100000:3.0:1782529105.104248:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782529105.104254:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117192576:12345-0@lo:501: 00000100:00100000:3.0:1782529105.104808:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117192576:12345-0@lo:501: Request processed in 227us (295us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782529105.104817:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782529105.104880:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117192576:0@lo:501: 10000000:01000000:3.0:1782529105.104910:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782529105.104937:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529105.104944:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782529105.177765:0:7957:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782529105.177796:0:7957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1869117117192832:0@lo:7: 00000100:00100000:2.0:1782529105.177886:0:7957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529105.177962:0:7957:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6659adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529105.178031:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117192704:0@lo:13: 00000100:00100000:3.0:1782529105.178069:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529105.178112:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117192704 00000100:00100000:3.0:1782529105.178119:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117192704 00000100:00100000:3.0:1782529105.178178:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782529105.178188:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1869117117192704:12345-0@lo:13: 00002000:00000024:3.0:1782529105.178226:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1782529105.178272:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1869117117192704:12345-0@lo:13: Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529105.178279:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1782529105.178300:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782529105.178327:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000b100 x1869117117192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529105.178345:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117192704:0@lo:13: 00000100:00100000:1.0:1782529105.178417:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117192832 00000100:00100000:1.0:1782529105.178422:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117192832 00000100:00100000:1.0:1782529105.178459:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782529105.178467:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7957:x1869117117192832:12345-0@lo:7: 00002000:00080000:1.0:1782529105.185022:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1782529105.185030:0:6591:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1782529105.185176:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7957:x1869117117192832:12345-0@lo:7: Request processed in 6705us (7286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529105.185187:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782529105.187095:0:7957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680008700 x1869117117192832/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782529121 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529105.187114:0:7957:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1869117117192832:0@lo:7: 00000004:00080000:2.0:1782529105.187129:0:7957:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782529105.187173:0:7957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1869117117192960:0@lo:5: 00000100:00100000:2.0:1782529105.187227:0:7957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529105.187286:0:7957:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6659adc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782529105.187426:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117192960 00000100:00100000:1.0:1782529105.187442:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117192960 00000100:00100000:1.0:1782529105.187499:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782529105.187508:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7957:x1869117117192960:12345-0@lo:5: 00002000:00080000:1.0:1782529105.187648:0:6593:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782529105.187653:0:6593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1782529105.188181:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7957:x1869117117192960:12345-0@lo:5: Request processed in 673us (952us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782529105.188189:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782529105.188352:0:7957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680008700 x1869117117192960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782529121 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529105.188379:0:7957:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1869117117192960:0@lo:5: 00000004:00080000:0.0:1782529105.188391:0:7957:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782529105.188420:0:7957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1869117117193088:0@lo:700: 00000100:00100000:0.0:1782529105.188449:0:7957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.188480:0:7957:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646ad6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782529105.188596:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117193088 00000100:00100000:2.0:1782529105.188601:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117193088 00000100:00100000:2.0:1782529105.188637:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529105.188645:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7957:x1869117117193088:12345-0@lo:700: 00000100:00100000:2.0:1782529105.188676:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6599:1869117117193216:0@lo:700: 00000100:00100000:2.0:1782529105.188772:0:6599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529105.188790:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6659adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529105.188865:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117193216 00000100:00100000:0.0:1782529105.188870:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117193216 00000100:00100000:0.0:1782529105.188979:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782529105.188986:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6599:x1869117117193216:12345-0@lo:700: 00000004:00080000:3.0:1782529105.209624:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1782529105.236027:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1782529105.241676:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6599:x1869117117193216:12345-0@lo:700: Request processed in 52681us (52894us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529105.241694:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782529105.242294:0:6599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000b800 x1869117117193216/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782529121 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529105.242312:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6599:1869117117193216:0@lo:700: 40000000:02000000:2.0:1782529105.242328:0:6599:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1782529105.302644:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1782529105.302665:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782529105.303356:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7957:x1869117117193088:12345-0@lo:700: Request processed in 114708us (114902us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529105.303370:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782529105.303458:0:7957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b09f80 x1869117117193088/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782529121 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529105.303470:0:7957:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782529105.303489:0:7957:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1869117117193088:0@lo:700: 00000004:02000040:0.0:1782529105.332385:0:7957:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1782529105.337284:0:7957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1869117117193344:0@lo:5: 00000100:00100000:0.0:1782529105.337358:0:7957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529105.337481:0:7957:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646abdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529105.337754:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117193344 00000100:00100000:1.0:1782529105.337762:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117193344 00000100:00100000:1.0:1782529105.337869:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782529105.337880:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7957:x1869117117193344:12345-0@lo:5: 00002000:00080000:3.0:1782529105.345296:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1782529105.345321:0:6591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00010000:00010000:0.0:1782529105.351242:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529105.351555:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7957:x1869117117193344:12345-0@lo:5: Request processed in 13672us (14192us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782529105.351590:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1782529105.351813:0:7957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b09f80 x1869117117193344/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782529121 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529105.351973:0:7957:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1869117117193344:0@lo:5: 00000004:00080000:0.0:1782529105.351990:0:7957:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1782529106.375229:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529107.408546:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529108.051237:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529108.051266:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117193472:0@lo:13: 00000100:00100000:0.0:1782529108.051348:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529108.051664:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117193472 00000100:00100000:3.0:1782529108.051674:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117193472 00000100:00080000:0.0:1782529108.051998:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529108.052140:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782529108.052157:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117193472:12345-0@lo:13: 00002000:00000024:3.0:1782529108.052197:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529108.052266:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117193472:12345-0@lo:13: Request processed in 116us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529108.052273:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782529108.052491:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b09500 x1869117117193472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529108.052514:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117193472:0@lo:13: 00010000:00010000:3.0:1782529108.423540:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782529108.508242:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1782529109.138656:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529109.138858:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108781184 00000100:00100000:1.0:1782529109.138868:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108781184 00000100:00100000:1.0:1782529109.138919:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 111 00000100:00100000:1.0:1782529109.138928:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2340:x1869117108781184:12345-192.168.202.50@tcp:250: 00010000:00080000:1.0:1782529109.138960:0:5789:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7fc22fc8-b7b5-4103-b13b-bcf6224dd145@192.168.202.50@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1782529109.138991:0:5789:0:(genops.c:1406:class_connect()) connect: client 7fc22fc8-b7b5-4103-b13b-bcf6224dd145, cookie 0x72bfdc08f7eabade 00000100:00080000:1.0:1782529109.139142:0:5789:0:(import.c:65:import_set_state_nolock()) ffff99c677940000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529109.139218:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+5:2340:x1869117108781184:12345-192.168.202.50@tcp:250: Request processed in 289us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529109.139225:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 111 00000100:00100000:1.0:1782529109.160741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529109.162537:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108781312 00000100:00100000:2.0:1782529109.162551:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108781312 00000100:00100000:2.0:1782529109.162607:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 112 00000100:00100000:2.0:1782529109.162618:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+5:5547:x1869117108781312:12345-192.168.202.50@tcp:101: 00010000:00010000:2.0:1782529109.162638:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529109.162658:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adc7f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529109.162688:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529109.162700:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529109.162710:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00a00, rc 0) 00000100:00100000:2.0:1782529109.162770:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+6:5547:x1869117108781312:12345-192.168.202.50@tcp:101: Request processed in 154us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529109.162778:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 112 00000100:00100000:3.0:1782529109.167661:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529109.167786:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108781440 00000100:00100000:0.0:1782529109.167797:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108781440 00000100:00100000:0.0:1782529109.167870:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 113 00000100:00100000:0.0:1782529109.167891:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+6:5547:x1869117108781440:12345-192.168.202.50@tcp:501: 00000100:00100000:0.0:1782529109.168224:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+6:5547:x1869117108781440:12345-192.168.202.50@tcp:501: Request processed in 342us (571us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782529109.168232:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 113 00000100:00100000:2.0:1782529109.172616:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529109.174958:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108781568 00000100:00100000:1.0:1782529109.174985:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108781568 00000100:00100000:1.0:1782529109.175045:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:1.0:1782529109.175056:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+6:5547:x1869117108781568:12345-192.168.202.50@tcp:101: 00010000:00010000:1.0:1782529109.175075:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529109.175097:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adc86 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529109.175130:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 7 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529109.175142:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 7 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529109.175153:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a577200, rc 0) 00000100:00100000:1.0:1782529109.175221:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+7:5547:x1869117108781568:12345-192.168.202.50@tcp:101: Request processed in 166us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529109.175229:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:3.0:1782529109.177923:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529109.177958:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108781696 00000100:00100000:3.0:1782529109.177967:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108781696 00000100:00100000:3.0:1782529109.178008:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:3.0:1782529109.178018:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+7:5547:x1869117108781696:12345-192.168.202.50@tcp:501: 00000100:00100000:3.0:1782529109.178271:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5547:x1869117108781696:12345-192.168.202.50@tcp:501: Request processed in 252us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529109.178280:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:3.0:1782529109.180572:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529109.180686:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108781824 00000100:00100000:1.0:1782529109.180695:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108781824 00000100:00100000:1.0:1782529109.180770:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:1.0:1782529109.180780:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5547:x1869117108781824:12345-192.168.202.50@tcp:503: 00000100:00100000:1.0:1782529109.181171:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5547:x1869117108781824:12345-192.168.202.50@tcp:503: Request processed in 391us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529109.181181:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:3.0:1782529109.183856:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529109.184365:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108781952 00000100:00100000:1.0:1782529109.184378:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108781952 00000100:00100000:1.0:1782529109.184444:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:1.0:1782529109.184456:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5565:x1869117108781952:12345-192.168.202.50@tcp:502: 00000100:00100000:1.0:1782529109.184819:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5565:x1869117108781952:12345-192.168.202.50@tcp:502: Request processed in 364us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529109.184827:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:1.0:1782529109.214327:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529109.214405:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108782080 00000100:00100000:3.0:1782529109.214415:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108782080 00000100:00100000:3.0:1782529109.214480:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:3.0:1782529109.214490:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5565:x1869117108782080:12345-192.168.202.50@tcp:502: 00000100:00100000:3.0:1782529109.214769:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5565:x1869117108782080:12345-192.168.202.50@tcp:502: Request processed in 279us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529109.214778:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:0.0:1782529109.222156:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529109.222329:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108782208 00000100:00100000:3.0:1782529109.222340:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108782208 00000100:00100000:3.0:1782529109.222396:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:3.0:1782529109.222406:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5547:x1869117108782208:12345-192.168.202.50@tcp:101: 00010000:00010000:3.0:1782529109.222426:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529109.222447:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c65972b400/0x72bfdc08f7eabaf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adcb0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529109.222478:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c65972b400/0x72bfdc08f7eabaf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb0 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529109.222490:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c65972b400/0x72bfdc08f7eabaf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb0 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529109.222509:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972b400, rc 0) 00000100:00100000:3.0:1782529109.222571:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5547:x1869117108782208:12345-192.168.202.50@tcp:101: Request processed in 165us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529109.222579:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:3.0:1782529109.230874:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529109.232668:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108782336 00000100:00100000:1.0:1782529109.232683:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108782336 00000100:00100000:1.0:1782529109.232760:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:1.0:1782529109.232772:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5547:x1869117108782336:12345-192.168.202.50@tcp:256: 20000000:01000000:1.0:1782529109.232806:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782529109.232827:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782529109.232849:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782529109.232853:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782529109.232856:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782529109.245442:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5547:x1869117108782336:12345-192.168.202.50@tcp:256: Request processed in 12663us (14570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529109.245456:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:1.0:1782529109.250076:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529109.250161:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108782464 00000100:00100000:3.0:1782529109.250170:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108782464 00000100:00100000:3.0:1782529109.250241:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:3.0:1782529109.250251:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5547:x1869117108782464:12345-192.168.202.50@tcp:101: 00010000:00010000:3.0:1782529109.250272:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529109.250293:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adcb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529109.250325:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529109.250337:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529109.250348:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972be00, rc 0) 00000100:00100000:3.0:1782529109.250404:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5547:x1869117108782464:12345-192.168.202.50@tcp:101: Request processed in 154us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529109.250412:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:2.0:1782529109.252560:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529109.252641:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108782592 00000100:00100000:3.0:1782529109.252649:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108782592 00000100:00100000:3.0:1782529109.252700:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:3.0:1782529109.252714:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5547:x1869117108782592:12345-192.168.202.50@tcp:501: 00000100:00100000:3.0:1782529109.253018:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5547:x1869117108782592:12345-192.168.202.50@tcp:501: Request processed in 304us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529109.253026:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:0.0:1782529109.255512:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529109.256095:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108782720 00000100:00100000:2.0:1782529109.256107:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108782720 00000100:00100000:2.0:1782529109.256172:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:2.0:1782529109.256184:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5547:x1869117108782720:12345-192.168.202.50@tcp:503: 00000100:00100000:2.0:1782529109.256684:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5547:x1869117108782720:12345-192.168.202.50@tcp:503: Request processed in 501us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529109.256693:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:1.0:1782529109.263215:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529109.263548:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108782848 00000100:00100000:3.0:1782529109.263559:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108782848 00000100:00100000:3.0:1782529109.263630:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:3.0:1782529109.263641:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5569:x1869117108782848:12345-192.168.202.50@tcp:502: 00000100:00100000:3.0:1782529109.263930:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5569:x1869117108782848:12345-192.168.202.50@tcp:502: Request processed in 291us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529109.263938:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:0.0:1782529109.269066:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529109.269144:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108782976 00000100:00100000:1.0:1782529109.269155:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108782976 00000100:00100000:1.0:1782529109.269242:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:1.0:1782529109.269252:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5569:x1869117108782976:12345-192.168.202.50@tcp:502: 00000100:00100000:1.0:1782529109.269508:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5569:x1869117108782976:12345-192.168.202.50@tcp:502: Request processed in 257us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529109.269517:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:3.0:1782529109.276703:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529109.276753:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108783104 00000100:00100000:3.0:1782529109.276763:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108783104 00000100:00100000:3.0:1782529109.276814:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1782529109.276825:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2340:x1869117108783104:12345-192.168.202.50@tcp:38: 00010000:00080000:3.0:1782529109.276901:0:5795:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:3.0:1782529109.276955:0:5795:0:(genops.c:1406:class_connect()) connect: client 089f7aa7-7be0-48a9-8829-cfc80cd2ee18, cookie 0x72bfdc08f7eabb01 00000004:00100000:3.0:1782529109.276990:0:5795:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1782529109.276997:0:5795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1782529109.311707:0:5795:0:(import.c:65:import_set_state_nolock()) ffff99c6587e3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782529109.311795:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2340:x1869117108783104:12345-192.168.202.50@tcp:38: Request processed in 34969us (35101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529109.311806:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00010000:00010000:2.0:1782529109.448890:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529110.087149:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117193600:0@lo:400: 00000100:00100000:2.0:1782529110.087244:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529110.087646:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117193600 00000100:00100000:0.0:1782529110.087656:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117193600 00000100:00100000:0.0:1782529110.087731:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782529110.087742:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117193600:12345-0@lo:400: 00000100:00100000:1.0:1782529110.088032:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117193728:0@lo:400: 00000100:00100000:1.0:1782529110.088072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529110.088104:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529110.088110:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117193856:0@lo:400: 00000100:00100000:1.0:1782529110.088153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529110.088188:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117193728 00000100:00100000:1.0:1782529110.088192:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117193728 00000100:00100000:1.0:1782529110.088223:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117193856 00000100:00100000:1.0:1782529110.088226:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117193856 00000100:00100000:1.0:1782529110.088257:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782529110.088264:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117193728:12345-0@lo:400: 00000100:00100000:1.0:1782529110.088305:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117193728:12345-0@lo:400: Request processed in 41us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529110.088312:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782529110.088335:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782529110.088341:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117193856:12345-0@lo:400: 00000100:00100000:1.0:1782529110.088369:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117193856:12345-0@lo:400: Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529110.088375:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1782529110.088393:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529110.088406:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117193984:0@lo:400: 00000100:00100000:1.0:1782529110.088446:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529110.088477:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117193984 00000100:00100000:1.0:1782529110.088481:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117193984 00000100:00100000:1.0:1782529110.088525:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782529110.088531:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117193984:12345-0@lo:400: 00000100:00100000:1.0:1782529110.088571:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117193984:12345-0@lo:400: Request processed in 40us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529110.088576:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1782529110.088587:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782529110.088616:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cded80 x1869117117193984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529110.088640:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117193984:0@lo:400: 00010000:00080000:1.0:1782529110.088669:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cde300 x1869117117193856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529110.088677:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117193856:0@lo:400: 00010000:00080000:1.0:1782529110.088685:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdd880 x1869117117193728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529110.088693:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117193728:0@lo:400: 00000100:00100000:0.0:1782529110.095774:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117193600:12345-0@lo:400: Request processed in 8021us (8517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529110.095790:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782529110.096116:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529110.096132:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117194240:0@lo:400: 00000100:00100000:3.0:1782529110.096191:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529110.096232:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117194240 00000100:00100000:3.0:1782529110.096239:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117194240 00000100:00100000:3.0:1782529110.096298:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782529110.096308:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117194240:12345-0@lo:400: 00000100:00100000:3.0:1782529110.096367:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117194240:12345-0@lo:400: Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529110.096374:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782529110.096443:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdc000 x1869117117194240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529110.096456:0:3297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782529110.096473:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117194240:0@lo:400: 00000100:00080000:3.0:1782529110.096490:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529110.096911:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529110.096925:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117194112:0@lo:400: 00000100:00100000:1.0:1782529110.096963:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529110.097087:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117194112 00000100:00100000:3.0:1782529110.097092:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117194112 00000100:00100000:3.0:1782529110.097142:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782529110.097149:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117194112:12345-0@lo:400: 00000100:00100000:3.0:1782529110.097185:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117194112:12345-0@lo:400: Request processed in 37us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529110.097191:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1782529110.097275:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782529110.097299:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdc380 x1869117117194112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529110.097309:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117194112:0@lo:400: 00000100:00100000:2.0:1782529110.100090:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117193600:0@lo:400: 00000100:00100000:0.0:1782529110.325456:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529110.326062:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108783232 00000100:00100000:3.0:1782529110.326076:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108783232 00000100:00100000:3.0:1782529110.326160:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1782529110.326171:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:0:x1869117108783232:12345-192.168.202.50@tcp:41: 00000004:00000024:3.0:1782529110.326222:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1782529110.326299:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:0:x1869117108783232:12345-192.168.202.50@tcp:41: Request processed in 128us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529110.326306:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1782529110.326354:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529110.326906:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108783360 00000100:00100000:2.0:1782529110.326912:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108783360 00000100:00100000:2.0:1782529110.326954:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:2.0:1782529110.326962:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5547:x1869117108783360:12345-192.168.202.50@tcp:41: 00000004:00000024:2.0:1782529110.326979:0:6616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1782529110.327030:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5547:x1869117108783360:12345-192.168.202.50@tcp:41: Request processed in 68us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529110.327037:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00080000:1.0:1782529110.327677:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529110.336120:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529110.342671:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108783488 00000100:00100000:3.0:1782529110.342687:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108783488 00000100:00100000:3.0:1782529110.342767:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1782529110.342778:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5547:x1869117108783488:12345-192.168.202.50@tcp:40: 00000100:00100000:3.0:1782529110.342924:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5547:x1869117108783488:12345-192.168.202.50@tcp:40: Request processed in 147us (6813us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529110.342947:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1782529110.348952:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529110.349004:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529110.349130:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108783872 00000100:00100000:2.0:1782529110.349140:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108783872 00000100:00100000:2.0:1782529110.349203:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1782529110.349214:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5547:x1869117108783872:12345-192.168.202.50@tcp:33: 00000100:00100000:1.0:1782529110.350359:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108784000 00000100:00100000:1.0:1782529110.350369:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108784000 00000100:00100000:1.0:1782529110.350426:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:1.0:1782529110.350435:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2341:x1869117108784000:12345-192.168.202.50@tcp:400: 00000100:00100000:1.0:1782529110.350520:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2341:x1869117108784000:12345-192.168.202.50@tcp:400: Request processed in 85us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529110.350528:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:1.0:1782529110.355621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529110.355700:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529110.355737:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108783616 00000100:00100000:1.0:1782529110.355749:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108783616 00000100:00100000:1.0:1782529110.355787:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108783744 00000100:00100000:1.0:1782529110.355790:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108783744 00000100:00100000:1.0:1782529110.355804:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:1.0:1782529110.355813:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1869117108783616:12345-192.168.202.50@tcp:8: 00010000:00080000:1.0:1782529110.355868:0:6591:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1782529110.355913:0:6591:0:(genops.c:1406:class_connect()) connect: client 089f7aa7-7be0-48a9-8829-cfc80cd2ee18, cookie 0x72bfdc08f7eabb08 00002000:00100000:1.0:1782529110.355927:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 089f7aa7-7be0-48a9-8829-cfc80cd2ee18/ffff99c677945800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782529110.355951:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782529110.356623:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782529110.356664:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c677944000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529110.356743:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2340:x1869117108783616:12345-192.168.202.50@tcp:8: Request processed in 929us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529110.356753:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:1.0:1782529110.356778:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1782529110.356784:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1869117108783744:12345-192.168.202.50@tcp:8: 00010000:00080000:1.0:1782529110.356807:0:6591:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1782529110.356828:0:6591:0:(genops.c:1406:class_connect()) connect: client 089f7aa7-7be0-48a9-8829-cfc80cd2ee18, cookie 0x72bfdc08f7eabb0f 00002000:00100000:1.0:1782529110.356858:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 089f7aa7-7be0-48a9-8829-cfc80cd2ee18/ffff99c677941800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782529110.356887:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782529110.361023:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782529110.361073:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c677943800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529110.361154:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2340:x1869117108783744:12345-192.168.202.50@tcp:8: Request processed in 4367us (5452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529110.361178:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000004:00080000:2.0:1782529110.403310:0:5797:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 54014us 00000004:00200000:0.0:1782529110.431604:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782529110.431813:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5547:x1869117108783872:12345-192.168.202.50@tcp:33: Request processed in 82594us (82865us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529110.431887:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00010000:00010000:3.0:1782529110.471344:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529110.600023:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529110.600049:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117194368:0@lo:13: 00000100:00100000:1.0:1782529110.600119:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529110.600342:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117194368 00000100:00100000:0.0:1782529110.600350:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117194368 00000100:00100000:0.0:1782529110.600400:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782529110.600408:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117194368:12345-0@lo:13: 00002000:00000024:0.0:1782529110.600431:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529110.600483:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117194368:12345-0@lo:13: Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529110.600490:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1782529110.600718:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b09f80 x1869117117194368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529110.600734:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117194368:0@lo:13: 00000100:00100000:2.0:1782529110.710474:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529110.710637:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108784128 00000100:00100000:0.0:1782529110.710648:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108784128 00000100:00100000:0.0:1782529110.710711:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1782529110.710721:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5586:x1869117108784128:12345-192.168.202.50@tcp:101: 00010000:00010000:0.0:1782529110.710744:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529110.710827:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eabb16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adce1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529110.710947:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabb1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529110.710964:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabb1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529110.710980:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabb1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529110.711199:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782529110.711203:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529110.711271:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabb1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529110.711325:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eabb16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adce1 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529110.711342:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabb1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adce1 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529110.711351:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529110.711354:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782529110.711357:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031400, rc 0) 00000100:00100000:0.0:1782529110.711428:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:5586:x1869117108784128:12345-192.168.202.50@tcp:101: Request processed in 709us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529110.711435:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000001:00100000:1.0:1782529111.203965:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00010000:00010000:2.0:1782529111.495786:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529112.520194:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529113.111396:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529113.111479:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108784256 00000100:00100000:3.0:1782529113.111490:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108784256 00000100:00100000:3.0:1782529113.111568:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:3.0:1782529113.111581:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:5639:x1869117108784256:12345-192.168.202.50@tcp:41: 00000004:00000024:3.0:1782529113.111627:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1782529113.111703:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:5639:x1869117108784256:12345-192.168.202.50@tcp:41: Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529113.111711:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00080000:1.0:1782529113.111777:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529113.115040:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529113.117959:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108784384 00000100:00100000:0.0:1782529113.117976:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108784384 00000100:00100000:0.0:1782529113.118073:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:0.0:1782529113.118086:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:5639:x1869117108784384:12345-192.168.202.50@tcp:13: 00002000:00000024:0.0:1782529113.118126:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782529113.118355:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529113.118547:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:5639:x1869117108784384:12345-192.168.202.50@tcp:13: Request processed in 462us (3517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529113.118554:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:0.0:1782529113.125314:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529113.125409:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108784512 00000100:00100000:3.0:1782529113.125420:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108784512 00000100:00100000:3.0:1782529113.125494:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1782529113.125507:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5639:x1869117108784512:12345-192.168.202.50@tcp:13: 00002000:00000024:3.0:1782529113.125550:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529113.125622:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:5639:x1869117108784512:12345-192.168.202.50@tcp:13: Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529113.125630:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00080000:1.0:1782529113.125728:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529113.161289:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117194624:0@lo:400: 00000100:00100000:2.0:1782529113.161307:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117194880:0@lo:400: 00000100:00100000:1.0:1782529113.161387:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117194496:0@lo:400: 00000100:00100000:0.0:1782529113.161984:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117194752:0@lo:400: 00000100:00100000:2.0:1782529113.162338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529113.162429:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117194880 00000100:00100000:2.0:1782529113.162437:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117194880 00000100:00100000:2.0:1782529113.162495:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782529113.162505:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117194880:12345-0@lo:400: 00000100:00100000:2.0:1782529113.162561:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117194880:12345-0@lo:400: Request processed in 58us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529113.162569:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1782529113.162592:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782529113.162617:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000b480 x1869117117194880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529113.162632:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117194880:0@lo:400: 00000100:00100000:3.0:1782529113.164207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529113.164214:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529113.164293:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117194624 00000100:00100000:2.0:1782529113.164301:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117194624 00000100:00100000:2.0:1782529113.164349:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782529113.164358:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117194624:12345-0@lo:400: 00000100:00100000:2.0:1782529113.164413:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117194624:12345-0@lo:400: Request processed in 56us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529113.164420:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782529113.164444:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117194496 00000100:00100000:2.0:1782529113.164447:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117194496 00000100:00100000:2.0:1782529113.164472:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782529113.164479:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117194496:12345-0@lo:400: 00000100:00100000:2.0:1782529113.164508:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117194496:12345-0@lo:400: Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529113.164515:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782529113.164597:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117194496:0@lo:400: 00000100:00100000:1.0:1782529113.164608:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117195008:0@lo:400: 00000100:00100000:1.0:1782529113.164631:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529113.164671:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529113.164677:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117195136:0@lo:400: 00000100:00100000:1.0:1782529113.164699:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529113.164725:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117195136 00000100:00100000:1.0:1782529113.164729:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117195136 00000100:00100000:1.0:1782529113.164761:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782529113.164767:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117195136:12345-0@lo:400: 00000100:00100000:1.0:1782529113.164798:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117195136:12345-0@lo:400: Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529113.164887:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117195008 00000100:00100000:2.0:1782529113.164891:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117195008 00000100:00100000:2.0:1782529113.165048:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782529113.165056:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117195008:12345-0@lo:400: 00000100:00100000:2.0:1782529113.165089:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117195008:12345-0@lo:400: Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529113.165095:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782529113.165099:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117194624:0@lo:400: 00000100:00080000:3.0:1782529113.165153:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782529113.165157:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529113.165160:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1782529113.165185:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680008000 x1869117117195136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529113.165197:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117195136:0@lo:400: 00000100:00100000:1.0:1782529113.165207:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117195008:0@lo:400: 00000100:00100000:0.0:1782529113.165283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529113.165348:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117195264:0@lo:13: 00000100:00100000:0.0:1782529113.165373:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529113.165459:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117195264 00000100:00100000:3.0:1782529113.165463:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117195264 00000100:00100000:3.0:1782529113.165527:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782529113.165534:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117195264:12345-0@lo:13: 00002000:00000024:3.0:1782529113.165550:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529113.165595:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117195264:12345-0@lo:13: Request processed in 61us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529113.165601:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782529113.165656:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b08a80 x1869117117195264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529113.165674:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117195264:0@lo:13: 00000100:00100000:2.0:1782529113.165714:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117194752 00000100:00100000:2.0:1782529113.165718:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117194752 00000100:00100000:2.0:1782529113.165754:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782529113.165759:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117194752:12345-0@lo:400: 00000100:00100000:2.0:1782529113.165788:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117194752:12345-0@lo:400: Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529113.165793:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782529113.166099:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117194752:0@lo:400: 00000100:00080000:1.0:1782529113.166118:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782529113.543634:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529114.570081:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782529114.742591:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000001:00100000:2.0:1782529114.763382:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000100:00100000:2.0:1782529115.484133:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529115.484172:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529115.484207:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529115.484239:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529115.484241:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108784896 00000100:00100000:0.0:1782529115.484252:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108784896 00000100:00100000:2.0:1782529115.484267:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108784768 00000100:00100000:2.0:1782529115.484273:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108784768 00000100:00100000:2.0:1782529115.484332:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:2.0:1782529115.484343:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108784768:12345-192.168.202.50@tcp:400: 00000100:00100000:2.0:1782529115.484436:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108784768:12345-192.168.202.50@tcp:400: Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529115.484443:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:2.0:1782529115.484466:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108785024 00000100:00100000:2.0:1782529115.484481:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108785024 00000100:00100000:2.0:1782529115.484505:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:2.0:1782529115.484511:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108784896:12345-192.168.202.50@tcp:400: 00000100:00100000:0.0:1782529115.484521:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:0.0:1782529115.484534:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108785024:12345-192.168.202.50@tcp:400: 00000100:00100000:2.0:1782529115.484542:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108784896:12345-192.168.202.50@tcp:400: Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529115.484551:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:0.0:1782529115.484574:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108785024:12345-192.168.202.50@tcp:400: Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529115.484583:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1782529115.484585:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108784640 00000100:00100000:1.0:1782529115.484589:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108784640 00000100:00080000:0.0:1782529115.484619:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529115.484620:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 129 00000100:00080000:0.0:1782529115.484625:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529115.484628:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2344:x1869117108784640:12345-192.168.202.50@tcp:400: 00000100:00080000:0.0:1782529115.484628:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529115.484659:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2344:x1869117108784640:12345-192.168.202.50@tcp:400: Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529115.484665:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 129 00010000:00010000:2.0:1782529115.592892:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529115.719382:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529115.719409:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117195392:0@lo:13: 00000100:00100000:1.0:1782529115.719478:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529115.719588:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117195392 00000100:00100000:0.0:1782529115.719595:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117195392 00000100:00100000:0.0:1782529115.719683:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782529115.719694:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117195392:12345-0@lo:13: 00002000:00000024:0.0:1782529115.719731:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529115.719775:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117195392:12345-0@lo:13: Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529115.719782:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1782529115.719940:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782529115.719969:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b0b480 x1869117117195392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529115.719987:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117195392:0@lo:13: 00000001:02000400:1.0:1782529116.200316:0:8160:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782529116.616562:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529117.642009:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529118.279307:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117195648:0@lo:400: 00000100:00100000:3.0:1782529118.279381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529118.279441:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117196160:0@lo:400: 00000100:00100000:3.0:1782529118.279471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529118.279503:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782529118.279508:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117195520:0@lo:400: 00000100:00100000:3.0:1782529118.279536:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529118.279555:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117196032:0@lo:400: 00000100:00100000:3.0:1782529118.279575:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529118.279601:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117195776:0@lo:400: 00000100:00100000:3.0:1782529118.279625:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529118.279643:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782529118.279648:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117195904:0@lo:400: 00000100:00100000:3.0:1782529118.279668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529118.279701:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117195648 00000100:00100000:3.0:1782529118.279718:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117195648 00000100:00100000:3.0:1782529118.279762:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117196032 00000100:00100000:3.0:1782529118.279765:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117196032 00000100:00100000:3.0:1782529118.279790:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117195776 00000100:00100000:3.0:1782529118.279793:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117195776 00000100:00100000:3.0:1782529118.279823:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782529118.279852:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117195648:12345-0@lo:400: 00000100:00100000:3.0:1782529118.279906:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117195648:12345-0@lo:400: Request processed in 75us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529118.279914:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782529118.280069:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782529118.280077:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117196032:12345-0@lo:400: 00000100:00100000:3.0:1782529118.280106:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117196032:12345-0@lo:400: Request processed in 30us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529118.280112:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782529118.280127:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782529118.280133:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117195776:12345-0@lo:400: 00000100:00100000:3.0:1782529118.280163:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117195776:12345-0@lo:400: Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529118.280169:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782529118.280188:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117196160 00000100:00100000:3.0:1782529118.280191:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117196160 00000100:00100000:3.0:1782529118.280219:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117195904 00000100:00100000:3.0:1782529118.280222:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117195904 00000100:00100000:3.0:1782529118.280240:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782529118.280246:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117196160:12345-0@lo:400: 00000100:00100000:3.0:1782529118.280275:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117196160:12345-0@lo:400: Request processed in 29us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529118.280291:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782529118.280301:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782529118.280307:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117195904:12345-0@lo:400: 00000100:00100000:3.0:1782529118.280330:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117195904:12345-0@lo:400: Request processed in 24us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529118.280335:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782529118.280351:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117195520 00000100:00100000:3.0:1782529118.280355:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117195520 00000100:00100000:3.0:1782529118.280377:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782529118.280383:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117195520:12345-0@lo:400: 00000100:00100000:3.0:1782529118.280406:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117195520:12345-0@lo:400: Request processed in 24us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529118.280548:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:3.0:1782529118.280612:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cded80 x1869117117195904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529118.280628:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117195904:0@lo:400: 00000100:00100000:3.0:1782529118.280640:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117195776:0@lo:400: 00000100:00100000:3.0:1782529118.280669:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117195520:0@lo:400: 00000100:00100000:3.0:1782529118.280678:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117196032:0@lo:400: 00000100:00100000:3.0:1782529118.280687:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117195648:0@lo:400: 00010000:00080000:3.0:1782529118.280696:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb60380 x1869117117196160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529118.280705:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117196160:0@lo:400: 00000100:00080000:1.0:1782529118.293359:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782529118.293369:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782529118.293373:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529118.293618:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117196288:0@lo:13: 00000100:00100000:3.0:1782529118.293689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529118.293775:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117196288 00000100:00100000:2.0:1782529118.293783:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117196288 00000100:00100000:2.0:1782529118.293870:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782529118.293880:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117196288:12345-0@lo:13: 00002000:00000024:2.0:1782529118.293914:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529118.293960:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117196288:12345-0@lo:13: Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529118.293967:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1782529118.294074:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680008000 x1869117117196288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529118.294092:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117196288:0@lo:13: 00010000:00010000:3.0:1782529118.663118:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529119.687005:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782529120.118057:0:8311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa020f8e0 20000000:00000080:1.0:1782529120.118087:0:8311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99c6807c0800 uarg=0000000000000000 20000000:01000000:1.0:1782529120.118369:0:8311:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1782529120.118372:0:8311:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1782529120.118375:0:8311:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1782529120.118379:0:8311:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1782529120.118384:0:8311:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1782529120.118396:0:8311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782529120.118406:0:8311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1782529120.118966:0:8311:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782529120.118970:0:8311:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782529120.120685:0:8312:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1782529120.122023:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1782529120.122370:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1782529120.122521:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1782529120.122541:0:8311:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782529120.122544:0:8311:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782529120.124609:0:8313:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1782529120.126723:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1782529120.127041:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1782529120.127354:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1782529120.127375:0:8311:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782529120.127378:0:8311:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782529120.129362:0:8314:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1782529120.133669:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1782529120.134708:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1782529120.135012:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1782529120.135037:0:8311:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782529120.135040:0:8311:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782529120.136824:0:8315:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1782529120.140137:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1782529120.140195:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1782529120.140557:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1782529120.140584:0:8311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782529120.140604:0:8311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140639:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140647:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140654:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140660:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140666:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140671:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140677:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140686:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140692:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.140698:0:8311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.141821:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.141975:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 9 pid: 5789 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.141990:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196416:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529120.142422:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.142432:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 9 pid: 5787 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.142451:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196544:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529120.142489:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.142498:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 18 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.142507:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196672:0@lo:104: 00000100:00100000:1.0:1782529120.142545:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782529120.142584:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.142593:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 18 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.142602:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196800:0@lo:104: 00000100:00100000:1.0:1782529120.142627:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782529120.142890:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.142899:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 18 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.142907:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196928:0@lo:104: 00010000:00010000:1.0:1782529120.142943:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.142950:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 18 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.142958:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117197056:0@lo:104: 00010000:00010000:1.0:1782529120.142975:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.142981:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 18 pid: 5789 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.142988:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117197184:0@lo:104: 00010000:00010000:1.0:1782529120.143004:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.143010:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 18 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.143017:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117197312:0@lo:104: 00010000:00010000:1.0:1782529120.143033:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.143040:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 18 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.143046:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117197440:0@lo:104: 00000100:00100000:1.0:1782529120.143058:0:8311:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529120.147416:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782529120.147589:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529120.147612:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529120.147623:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529120.147633:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529120.147642:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529120.147652:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117196672 00000100:00100000:3.0:1782529120.147660:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117196672 00000100:00100000:3.0:1782529120.147699:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117196800 00000100:00100000:3.0:1782529120.147702:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117196800 00000100:00100000:3.0:1782529120.147713:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117196928 00000100:00100000:3.0:1782529120.147716:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117196928 00000100:00100000:3.0:1782529120.147726:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117197056 00000100:00100000:3.0:1782529120.147728:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117197056 00000100:00100000:1.0:1782529120.147932:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196416:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529120.147944:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196544:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529120.148354:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117197184 00000100:00100000:3.0:1782529120.148358:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117197184 00000100:00100000:3.0:1782529120.148369:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117197312 00000100:00100000:3.0:1782529120.148372:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117197312 00000100:00100000:3.0:1782529120.148382:0:5776:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117197440 00000100:00100000:3.0:1782529120.148385:0:5776:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117197440 00000100:00100000:3.0:1782529120.148398:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782529120.148406:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+9:8311:x1869117117196672:12345-0@lo:104: 00010000:00010000:3.0:1782529120.148422:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529120.149046:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782529120.149053:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+9:8311:x1869117117196672:12345-0@lo:104: Request processed in 648us (6508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529120.149060:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782529120.149086:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782529120.149098:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+8:8311:x1869117117196800:12345-0@lo:104: 00010000:00010000:3.0:1782529120.149106:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529120.149136:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782529120.149141:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+8:8311:x1869117117196800:12345-0@lo:104: Request processed in 50us (6514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529120.149146:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782529120.149173:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782529120.149179:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+7:8311:x1869117117196928:12345-0@lo:104: 00010000:00010000:3.0:1782529120.149185:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529120.149216:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782529120.149220:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+7:8311:x1869117117196928:12345-0@lo:104: Request processed in 42us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529120.149224:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782529120.149234:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782529120.149238:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+6:8311:x1869117117197056:12345-0@lo:104: 00010000:00010000:3.0:1782529120.149244:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529120.149285:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782529120.149290:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+6:8311:x1869117117197056:12345-0@lo:104: Request processed in 52us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529120.149296:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782529120.149309:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782529120.149314:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+5:8311:x1869117117197184:12345-0@lo:104: 00010000:00010000:3.0:1782529120.149322:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529120.149347:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782529120.149351:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+5:8311:x1869117117197184:12345-0@lo:104: Request processed in 39us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529120.149356:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782529120.149368:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782529120.149373:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+4:8311:x1869117117197312:12345-0@lo:104: 00010000:00010000:3.0:1782529120.149380:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529120.149405:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1782529120.149410:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+4:8311:x1869117117197312:12345-0@lo:104: Request processed in 38us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529120.149415:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782529120.149427:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782529120.149432:0:5776:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:8311:x1869117117197440:12345-0@lo:104: 00010000:00010000:3.0:1782529120.150672:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529120.150984:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1782529120.150992:0:5776:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+3:8311:x1869117117197440:12345-0@lo:104: Request processed in 1559us (3347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529120.151000:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1782529120.151470:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1782529120.151478:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151487:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972bc00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529120.151491:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151510:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529120.151518:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529120.151524:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529120.151568:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151575:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529120.151598:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151606:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabad7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151619:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1782529120.151622:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151627:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030a00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529120.151629:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151636:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529120.151641:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529120.151653:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529120.151668:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151673:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529120.151686:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151692:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c640030a00/0x72bfdc08f7eabaa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabaad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151701:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1782529120.151704:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151709:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529120.151712:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151718:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529120.151723:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529120.151727:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529120.151755:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151761:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529120.151772:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151779:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eaba8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba91 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151797:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782529120.151801:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151806:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529120.151809:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151815:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529120.151822:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529120.151828:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529120.151875:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151881:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529120.151887:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151893:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eaba7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba83 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151902:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782529120.151909:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151915:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045200 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529120.151918:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151925:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529120.151931:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529120.151935:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529120.151948:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151954:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529120.151959:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151964:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682045200/0x72bfdc08f7eaba6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba75 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151972:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782529120.151975:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151980:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045600 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529120.151982:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.151997:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529120.152002:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529120.152007:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529120.152018:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.152021:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529120.152025:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.152030:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682045600/0x72bfdc08f7eaba44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba4b expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.152038:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529120.152040:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.152045:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ac00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529120.152047:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.152052:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529120.152058:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529120.152067:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529120.152947:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.152957:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529120.152964:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.152971:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972ac00/0x72bfdc08f7eaba1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba21 expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.152988:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529120.152990:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529120.152991:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529120.152999:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529120.153016:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117197568:0@lo:103: 00000100:00100000:2.0:1782529120.153380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529120.153473:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117198080:0@lo:103: 00000100:00100000:2.0:1782529120.153497:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529120.157064:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196672:0@lo:104: 00000100:00100000:1.0:1782529120.157182:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196800:0@lo:104: 00000100:00100000:1.0:1782529120.157192:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117196928:0@lo:104: 00000100:00100000:1.0:1782529120.157201:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117197056:0@lo:104: 00000100:00100000:1.0:1782529120.157209:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117197184:0@lo:104: 00000100:00100000:1.0:1782529120.157217:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117197312:0@lo:104: 00000100:00100000:1.0:1782529120.157224:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1869117117197440:0@lo:104: 00010000:00010000:1.0:1782529120.157414:0:8311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529120.158316:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117197696:0@lo:103: 00000100:00100000:3.0:1782529120.158386:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117197952:0@lo:103: 00000100:00100000:3.0:1782529120.159919:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117197824:0@lo:103: 00000100:00100000:3.0:1782529120.165455:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529120.169808:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529120.169901:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117197568 00000100:00100000:1.0:1782529120.169913:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117197568 00010000:00010000:1.0:1782529120.169960:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 19 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.169997:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117198080 00000100:00100000:1.0:1782529120.170000:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117198080 00010000:00010000:1.0:1782529120.170012:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 20 pid: 5789 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.170022:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108785152 00000100:00100000:1.0:1782529120.170025:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108785152 00010000:00010000:1.0:1782529120.170035:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 10 pid: 5789 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.170046:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782529120.172343:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+20:3297:x1869117117197568:12345-0@lo:103: 00010000:00010000:1.0:1782529120.172380:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529120.172391:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 20 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172405:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 20 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172424:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eabad0 expref: 20 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172441:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529120.172513:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117197568:12345-0@lo:103: Request processed in 2440us (19133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529120.172523:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782529120.172554:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782529120.172565:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:3297:x1869117117198080:12345-0@lo:103: 00010000:00010000:1.0:1782529120.172573:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529120.172577:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 18 pid: 5789 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172585:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 18 pid: 5789 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172594:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030000/0x72bfdc08f7eaba75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eaba6e expref: 18 pid: 5789 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172603:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529120.172624:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:3297:x1869117117198080:12345-0@lo:103: Request processed in 63us (19127us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529120.172646:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782529120.172662:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529120.172668:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2344:x1869117108785152:12345-192.168.202.50@tcp:103: 00010000:00010000:1.0:1782529120.172677:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529120.172682:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 10 pid: 5789 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172693:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 10 pid: 5789 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172703:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabaec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc86 expref: 10 pid: 5789 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.172711:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529120.172756:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:2344:x1869117108785152:12345-192.168.202.50@tcp:103: Request processed in 87us (7318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529120.172762:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529120.173561:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108785280 00000100:00100000:1.0:1782529120.173572:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108785280 00010000:00010000:1.0:1782529120.173600:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 9 pid: 5787 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529120.173633:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:1.0:1782529120.173640:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:2344:x1869117108785280:12345-192.168.202.50@tcp:103: 00010000:00010000:1.0:1782529120.173649:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529120.173654:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 9 pid: 5787 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.173679:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 9 pid: 5787 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.173691:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eabae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adc7f expref: 9 pid: 5787 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.173702:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529120.178344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529120.178410:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117198336:0@lo:103: 00000100:00100000:0.0:1782529120.178468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529120.178517:0:5779:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782529120.178526:0:5779:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1782529120.178626:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117197824 00000100:00100000:0.0:1782529120.178633:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117197824 00010000:00010000:0.0:1782529120.178664:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 17 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529120.178685:0:5779:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782529120.178690:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117198336 00000100:00100000:0.0:1782529120.178692:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117198336 00010000:00010000:0.0:1782529120.178702:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 18 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529120.178714:0:5779:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782529120.178722:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782529120.178729:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:3295:x1869117117197824:12345-0@lo:103: 00010000:00010000:0.0:1782529120.178742:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529120.178748:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 18 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.178758:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 18 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.178774:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a577400/0x72bfdc08f7eaba91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eaba8a expref: 18 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.178817:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529120.178870:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:3295:x1869117117197824:12345-0@lo:103: Request processed in 140us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529120.178877:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782529120.178891:0:5779:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782529120.178897:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782529120.178902:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3295:x1869117117198336:12345-0@lo:103: 00010000:00010000:0.0:1782529120.178909:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529120.178913:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 16 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.178921:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 16 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.178930:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eaba21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eaba1a expref: 16 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529120.178940:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529120.178962:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:3295:x1869117117198336:12345-0@lo:103: Request processed in 60us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529120.178967:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782529120.178998:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117197824:0@lo:103: 00000100:00100000:0.0:1782529120.179008:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117198336:0@lo:103: 00000100:00100000:1.0:1782529120.180311:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:2344:x1869117108785280:12345-192.168.202.50@tcp:103: Request processed in 6663us (10513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529120.180323:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1782529120.186139:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117198080:0@lo:103: 00000100:00100000:3.0:1782529120.186174:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117197568:0@lo:103: 00000100:00100000:2.0:1782529120.186424:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529120.186509:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117197952 00000100:00100000:2.0:1782529120.186517:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117197952 00010000:00010000:2.0:1782529120.186550:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 15 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529120.186588:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782529120.186597:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:3296:x1869117117197952:12345-0@lo:103: 00010000:00010000:2.0:1782529120.186612:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529120.186628:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 15 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.186636:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 15 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.186651:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030600/0x72bfdc08f7eaba83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eaba7c expref: 15 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.186664:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529120.186725:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:3296:x1869117117197952:12345-0@lo:103: Request processed in 129us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529120.186731:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782529120.186760:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117197952:0@lo:103: 00000100:00100000:2.0:1782529120.186781:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529120.186858:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117198208:0@lo:103: 00000100:00100000:2.0:1782529120.186890:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529120.186916:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117197696 00000100:00100000:2.0:1782529120.186920:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117197696 00010000:00010000:2.0:1782529120.186932:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 14 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529120.186944:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117198208 00000100:00100000:2.0:1782529120.186946:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117198208 00010000:00010000:2.0:1782529120.186955:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 15 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529120.186965:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782529120.186970:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650285050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:3294:x1869117117197696:12345-0@lo:103: 00010000:00010000:2.0:1782529120.186977:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529120.186987:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 15 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.186996:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 15 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.187006:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabaad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eabaa6 expref: 15 pid: 5788 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529120.187016:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529120.187044:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650285050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:3294:x1869117117197696:12345-0@lo:103: Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529120.187050:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782529120.187250:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782529120.187258:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+13:3294:x1869117117198208:12345-0@lo:103: 00010000:00010000:1.0:1782529120.187265:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529120.187268:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 13 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187283:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 13 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187290:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eaba4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eaba44 expref: 13 pid: 5787 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187299:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187305:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187316:0:8316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187326:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187331:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187335:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187338:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529120.187341:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187346:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187355:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187362:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529120.187380:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+12:3294:x1869117117198208:12345-0@lo:103: Request processed in 125us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529120.187385:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1782529120.187406:0:8311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187414:0:8311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529120.187420:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030e00/0x72bfdc08f7eabb24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529120.188488:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117197696:0@lo:103: 00000100:00100000:2.0:1782529120.188501:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117198208:0@lo:103: 00000100:00100000:2.0:1782529120.590488:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529120.590543:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529120.590594:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529120.590631:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108785536 00000100:00100000:2.0:1782529120.590636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529120.590646:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108785536 00000100:00100000:2.0:1782529120.590669:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108785792 00000100:00100000:2.0:1782529120.590673:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108785792 00000100:00100000:2.0:1782529120.590720:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108785664 00000100:00100000:2.0:1782529120.590722:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108785664 00000100:00100000:3.0:1782529120.590725:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:3.0:1782529120.590735:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108785536:12345-192.168.202.50@tcp:400: 00000100:00100000:2.0:1782529120.590738:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:2.0:1782529120.590743:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108785792:12345-192.168.202.50@tcp:400: 00000100:00100000:0.0:1782529120.590870:0:6593:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782529120.590874:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108785536:12345-192.168.202.50@tcp:400: Request processed in 140us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529120.590881:0:6593:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782529120.590882:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00080000:3.0:1782529120.590908:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782529120.590912:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782529120.590915:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529120.590928:0:6591:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782529120.590935:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1782529120.590941:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108785664:12345-192.168.202.50@tcp:400: 00000100:00100000:3.0:1782529120.590988:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108785664:12345-192.168.202.50@tcp:400: Request processed in 47us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529120.590995:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529120.591337:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108785408 00000100:00100000:1.0:1782529120.591342:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108785408 00000100:00100000:2.0:1782529120.591358:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108785792:12345-192.168.202.50@tcp:400: Request processed in 601us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529120.591377:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:1.0:1782529120.591381:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:1.0:1782529120.591390:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:2343:x1869117108785408:12345-192.168.202.50@tcp:400: 00000100:00100000:1.0:1782529120.591454:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:2343:x1869117108785408:12345-192.168.202.50@tcp:400: Request processed in 63us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529120.591462:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 131 00010000:00010000:2.0:1782529120.712308:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529120.841374:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529120.841415:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117198464:0@lo:13: 00000100:00100000:3.0:1782529120.841515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529120.841934:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117198464 00000100:00100000:0.0:1782529120.841945:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117198464 00000100:00100000:0.0:1782529120.842063:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782529120.842075:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117198464:12345-0@lo:13: 00002000:00000024:0.0:1782529120.842130:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529120.842190:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117198464:12345-0@lo:13: Request processed in 118us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529120.842199:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1782529120.843061:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782529120.843117:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b08a80 x1869117117198464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529120.843143:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117198464:0@lo:13: 00010000:00010000:2.0:1782529121.735136:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782529121.929953:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782529121.929961:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c67f60f000 from 39 10000000:01000000:0.0:1782529121.929967:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782529121.930023:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529121.930036:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529121.930048:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529121.930072:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117198592:0@lo:101: 00000100:00100000:0.0:1782529121.930147:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529121.930213:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6772709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529121.930333:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117198592 00000100:00100000:3.0:1782529121.930341:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117198592 00000100:00100000:3.0:1782529121.930402:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782529121.930412:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+12:5791:x1869117117198592:12345-0@lo:101: 00010000:00010000:3.0:1782529121.930425:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529121.930437:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eabb32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabb2b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.930459:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eabb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb2b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.930469:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eabb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb2b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.930476:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972a000, rc 0) 00000100:00100000:3.0:1782529121.930521:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117198592:12345-0@lo:101: Request processed in 111us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529121.930542:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782529121.930871:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117198592:0@lo:101: 00010000:00010000:0.0:1782529121.930886:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529121.930894:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529121.930950:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117198720:0@lo:501: 00000100:00100000:0.0:1782529121.930984:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529121.931013:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6772709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.931078:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117198720 00000100:00100000:1.0:1782529121.931083:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117198720 00000100:00100000:1.0:1782529121.931120:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782529121.931127:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117198720:12345-0@lo:501: 00000100:00100000:1.0:1782529121.931405:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117198720:12345-0@lo:501: Request processed in 277us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.931412:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782529121.932398:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117198720:0@lo:501: 00000100:00100000:0.0:1782529121.932443:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117198848:0@lo:503: 00000100:00100000:0.0:1782529121.932501:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529121.932538:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6772709c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529121.932618:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117198848 00000100:00100000:2.0:1782529121.932623:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117198848 00000100:00100000:2.0:1782529121.932678:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782529121.932687:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117198848:12345-0@lo:503: 00000100:00100000:2.0:1782529121.932930:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117198848:12345-0@lo:503: Request processed in 243us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529121.932950:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782529121.933397:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117198848:0@lo:503: 00000100:00100000:0.0:1782529121.934457:0:8330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8330:1869117117198976:0@lo:502: 00000100:00100000:0.0:1782529121.934515:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529121.934556:0:8330:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6772706c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529121.934662:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117198976 00000100:00100000:2.0:1782529121.934669:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117198976 00000100:00100000:2.0:1782529121.934708:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782529121.934717:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:8330:x1869117117198976:12345-0@lo:502: 00000100:00100000:2.0:1782529121.935003:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+13:8330:x1869117117198976:12345-0@lo:502: Request processed in 287us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529121.935010:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782529121.935291:0:8330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8330:1869117117198976:0@lo:502: 00000100:00100000:0.0:1782529121.935335:0:8330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8330:1869117117199104:0@lo:502: 00000100:00100000:0.0:1782529121.935370:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529121.935400:0:8330:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6772706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529121.935528:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117199104 00000100:00100000:3.0:1782529121.935533:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117199104 00000100:00100000:3.0:1782529121.935575:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782529121.935583:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:8330:x1869117117199104:12345-0@lo:502: 00000100:00100000:3.0:1782529121.935751:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+13:8330:x1869117117199104:12345-0@lo:502: Request processed in 168us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529121.935758:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782529121.936093:0:8330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8330:1869117117199104:0@lo:502: 00000040:00080000:0.0:1782529121.936114:0:8330:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782529121.937043:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782529121.937073:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782529121.937084:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.937094:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529121.937103:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782529121.937106:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1782529121.937109:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782529121.937140:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.937148:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.937157:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529121.937177:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117199232:0@lo:101: 00000100:00100000:3.0:1782529121.937247:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529121.937286:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.937709:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117199232 00000100:00100000:1.0:1782529121.937717:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117199232 00000100:00100000:1.0:1782529121.937770:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782529121.937788:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+13:5791:x1869117117199232:12345-0@lo:101: 00010000:00010000:1.0:1782529121.937799:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529121.937812:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eabb40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabb39 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.937872:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eabb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb39 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.937883:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eabb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb39 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.937901:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a576000, rc 0) 00000100:00100000:1.0:1782529121.937954:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117199232:12345-0@lo:101: Request processed in 168us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.937960:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782529121.938250:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117199232:0@lo:101: 00010000:00010000:2.0:1782529121.938267:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.938276:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529121.938334:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117199360:0@lo:501: 00000100:00100000:2.0:1782529121.938363:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.938406:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.938608:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117199360 00000100:00100000:0.0:1782529121.938614:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117199360 00000100:00100000:0.0:1782529121.938642:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782529121.938649:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117199360:12345-0@lo:501: 00000100:00100000:0.0:1782529121.939202:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117199360:12345-0@lo:501: Request processed in 552us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.939210:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782529121.939339:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117199360:0@lo:501: 00000100:00100000:2.0:1782529121.939381:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117199488:0@lo:503: 00000100:00100000:2.0:1782529121.939429:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.939466:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.939494:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117199488 00000100:00100000:1.0:1782529121.939499:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117199488 00000100:00100000:1.0:1782529121.939532:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782529121.939539:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117199488:12345-0@lo:503: 00000100:00100000:1.0:1782529121.939714:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117199488:12345-0@lo:503: Request processed in 176us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.939721:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782529121.939812:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117199488:0@lo:503: 00000100:00100000:1.0:1782529121.940314:0:8331:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8331:1869117117199616:0@lo:502: 00000100:00100000:1.0:1782529121.940358:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529121.940436:0:8331:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c650270a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529121.940648:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117199616 00000100:00100000:3.0:1782529121.940656:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117199616 00000100:00100000:3.0:1782529121.940690:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782529121.940696:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:8331:x1869117117199616:12345-0@lo:502: 00000100:00100000:3.0:1782529121.940900:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:8331:x1869117117199616:12345-0@lo:502: Request processed in 203us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529121.940908:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782529121.941056:0:8331:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8331:1869117117199616:0@lo:502: 00000020:01000000:1.0:1782529121.941081:0:8331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529121.941089:0:8331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529121.941092:0:8331:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782529121.941097:0:8331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782529121.941124:0:8331:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8331:1869117117199744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529121.941157:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529121.941187:0:8331:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c650270a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529121.941361:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117199744 00000100:00100000:3.0:1782529121.941366:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117199744 00000100:00100000:3.0:1782529121.941493:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782529121.941501:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:8331:x1869117117199744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529121.941643:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+14:8331:x1869117117199744:12345-0@lo:502:llog_process_th.0 Request processed in 142us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529121.941650:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782529121.941893:0:8331:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8331:1869117117199744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782529121.941924:0:8331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529121.941929:0:8331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529121.941930:0:8331:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782529121.941935:0:8331:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1782529121.943695:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1782529121.943725:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782529121.943736:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.943748:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529121.943759:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782529121.943762:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c6795ce000 from 39 10000000:01000000:2.0:1782529121.943770:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782529121.943814:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.943823:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.943875:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529121.943901:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117199872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.943969:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.945768:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64c55a480 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.947161:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117199872 00000100:00100000:1.0:1782529121.947174:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117199872 00000100:00100000:1.0:1782529121.947341:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782529121.947353:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:5791:x1869117117199872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529121.947383:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529121.947469:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabb4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabb47 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.947500:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb47 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.947510:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb47 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.947518:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a577200, rc 0) 00000100:00100000:1.0:1782529121.947655:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117199872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 305us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.947662:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782529121.948145:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117199872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529121.948173:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.948183:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529121.951161:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.951337:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.951382:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64c55a480 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.951487:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117200000 00000100:00100000:1.0:1782529121.951494:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117200000 00000100:00100000:1.0:1782529121.951545:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782529121.951553:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117200000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529121.951888:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117200000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.951896:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782529121.952543:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.952586:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.952635:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.952668:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64c55a480 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.952722:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117200128 00000100:00100000:0.0:1782529121.952727:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117200128 00000100:00100000:0.0:1782529121.952764:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782529121.952772:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117200128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529121.953306:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117200128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 455us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.953314:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782529121.953527:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.953904:0:8332:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8332:1869117117200256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529121.953961:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.953995:0:8332:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64c55a480 going to sleep for 11 seconds 00000100:00100000:3.0:1782529121.954127:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117200256 00000100:00100000:3.0:1782529121.954133:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117200256 00000100:00100000:3.0:1782529121.954168:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782529121.954176:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:8332:x1869117117200256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529121.954379:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+15:8332:x1869117117200256:12345-0@lo:502:llog_process_th.0 Request processed in 202us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529121.954517:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782529121.954690:0:8332:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8332:1869117117200256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529121.954733:0:8332:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8332:1869117117200384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529121.954767:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.954798:0:8332:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64608f540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.954867:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117200384 00000100:00100000:0.0:1782529121.954872:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117200384 00000100:00100000:0.0:1782529121.954904:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782529121.954911:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:8332:x1869117117200384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782529121.955193:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+15:8332:x1869117117200384:12345-0@lo:502:llog_process_th.0 Request processed in 282us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.955201:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782529121.955336:0:8332:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8332:1869117117200384:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782529121.955355:0:8332:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782529121.956987:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782529121.957018:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782529121.957030:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.957062:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529121.957073:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782529121.957076:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782529121.957079:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782529121.957112:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.957121:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.957133:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529121.957155:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782529121.957206:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529121.957246:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.957373:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117200512 00000100:00100000:1.0:1782529121.957381:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117200512 00000100:00100000:1.0:1782529121.957504:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782529121.957514:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:5791:x1869117117200512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529121.957527:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529121.957540:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a577e00/0x72bfdc08f7eabb5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabb55 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.957575:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a577e00/0x72bfdc08f7eabb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb55 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.957586:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a577e00/0x72bfdc08f7eabb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb55 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.957595:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a577e00, rc 0) 00000100:00100000:1.0:1782529121.957645:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117200512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.957652:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782529121.957748:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529121.957768:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.957787:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529121.957863:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.957891:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.957909:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64608f540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.958024:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117200640 00000100:00100000:0.0:1782529121.958028:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117200640 00000100:00100000:0.0:1782529121.958052:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782529121.958058:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117200640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529121.958332:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117200640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.958340:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782529121.958524:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.958554:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.958590:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.958620:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64608f540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.958657:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117200768 00000100:00100000:0.0:1782529121.958662:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117200768 00000100:00100000:0.0:1782529121.958685:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782529121.958690:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117200768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529121.958870:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117200768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.958877:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782529121.959010:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117200768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529121.959697:0:8333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8333:1869117117200896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529121.959827:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529121.959903:0:8333:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.960130:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117200896 00000100:00100000:0.0:1782529121.960135:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117200896 00000100:00100000:0.0:1782529121.960175:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782529121.960183:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:8333:x1869117117200896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782529121.960615:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:8333:x1869117117200896:12345-0@lo:502:llog_process_th.0 Request processed in 432us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.960623:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782529121.972242:0:8333:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8333:1869117117200896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782529121.972299:0:8333:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782529121.972311:0:8333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529121.972313:0:8333:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782529121.972319:0:8333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782529121.972362:0:8333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8333:1869117117201024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529121.973179:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.973241:0:8333:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64608f540 going to sleep for 11 seconds 00000100:00100000:3.0:1782529121.973345:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117201024 00000100:00100000:3.0:1782529121.973353:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117201024 00000100:00100000:3.0:1782529121.973485:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782529121.973495:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:8333:x1869117117201024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529121.973739:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:8333:x1869117117201024:12345-0@lo:502:llog_process_th.0 Request processed in 236us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529121.973756:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782529121.973948:0:8333:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8333:1869117117201024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782529121.973979:0:8333:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782529121.973985:0:8333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529121.973993:0:8333:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782529121.973998:0:8333:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1782529121.974326:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1782529121.974344:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782529121.974354:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.974363:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529121.974373:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782529121.974376:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c646a6f800 from 39 10000000:01000000:3.0:1782529121.974378:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782529121.974476:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.974485:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529121.974492:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529121.974511:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782529121.974548:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529121.974583:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c678332f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.974716:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117201152 00000100:00100000:1.0:1782529121.974722:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117201152 00000100:00100000:1.0:1782529121.974766:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782529121.974782:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117201152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529121.974793:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529121.974806:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a577800/0x72bfdc08f7eabb6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabb63 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.974826:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a577800/0x72bfdc08f7eabb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb63 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.974868:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a577800/0x72bfdc08f7eabb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb63 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.974876:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a577800, rc 0) 00000100:00100000:1.0:1782529121.974914:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117201152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.974920:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782529121.975166:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529121.975180:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.975188:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529121.975245:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.975275:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.975293:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64608f540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.975343:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117201280 00000100:00100000:0.0:1782529121.975348:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117201280 00000100:00100000:0.0:1782529121.975378:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782529121.975394:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117201280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529121.975652:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117201280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.975659:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782529121.975916:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.975960:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.975997:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.976014:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64608f540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.976182:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117201408 00000100:00100000:1.0:1782529121.976187:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117201408 00000100:00100000:1.0:1782529121.976208:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782529121.976214:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117201408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529121.976376:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117201408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529121.976517:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.976691:0:8334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8334:1869117117201536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529121.976742:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.976753:0:8334:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64608f000 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.976828:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782529121.976890:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117201536 00000100:00100000:1.0:1782529121.976894:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117201536 00000100:00100000:1.0:1782529121.976910:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782529121.976915:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:8334:x1869117117201536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529121.977604:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:8334:x1869117117201536:12345-0@lo:502:llog_process_th.0 Request processed in 686us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.977612:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782529121.980680:0:8334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8334:1869117117201536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529121.982526:0:8334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8334:1869117117201664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529121.982623:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529121.982715:0:8334:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c678332780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.983499:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117201664 00000100:00100000:0.0:1782529121.983509:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117201664 00000100:00100000:0.0:1782529121.983614:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782529121.983624:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:8334:x1869117117201664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782529121.984111:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:8334:x1869117117201664:12345-0@lo:502:llog_process_th.0 Request processed in 487us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.984121:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782529121.984228:0:8334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8334:1869117117201664:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782529121.984265:0:8334:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782529121.984488:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782529121.984506:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782529121.984515:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.984537:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529121.984548:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782529121.984550:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1782529121.984553:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782529121.984580:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.984589:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.984597:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529121.984614:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.984650:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529121.989568:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.989701:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117201792 00000100:00100000:1.0:1782529121.989713:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117201792 00000100:00100000:1.0:1782529121.989785:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782529121.989795:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117201792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529121.989813:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529121.989830:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a576600/0x72bfdc08f7eabb78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabb71 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.989880:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a576600/0x72bfdc08f7eabb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb71 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.989891:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a576600/0x72bfdc08f7eabb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb71 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529121.989918:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a576600, rc 0) 00000100:00100000:1.0:1782529121.990007:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117201792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (5356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.990013:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782529121.990175:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529121.990193:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529121.990202:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529121.990263:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.990293:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.990311:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.991704:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117201920 00000100:00100000:1.0:1782529121.991716:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117201920 00000100:00100000:1.0:1782529121.991757:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782529121.991765:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117201920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529121.992110:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117201920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.992118:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782529121.992255:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117201920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.992305:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117202048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529121.992351:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529121.992374:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529121.992725:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117202048 00000100:00100000:1.0:1782529121.992731:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117202048 00000100:00100000:1.0:1782529121.992755:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782529121.992762:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117202048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529121.993318:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117202048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 554us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529121.993326:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782529121.993517:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117202048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529121.994599:0:8335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8335:1869117117202176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529121.994666:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529121.994742:0:8335:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c650270480 going to sleep for 11 seconds 00000100:00100000:0.0:1782529121.994795:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117202176 00000100:00100000:0.0:1782529121.994801:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117202176 00000100:00100000:0.0:1782529121.997435:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782529121.997456:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:8335:x1869117117202176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782529121.997817:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:8335:x1869117117202176:12345-0@lo:502:llog_process_th.0 Request processed in 368us (3149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529121.997826:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782529121.998013:0:8335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8335:1869117117202176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782529121.998049:0:8335:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782529121.998059:0:8335:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529121.998061:0:8335:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782529121.998068:0:8335:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782529121.998103:0:8335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8335:1869117117202304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529121.998152:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529122.003069:0:8335:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601e40 going to sleep for 10 seconds 00000100:00100000:1.0:1782529122.003499:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117202304 00000100:00100000:1.0:1782529122.003510:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117202304 00000100:00100000:1.0:1782529122.003570:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782529122.003580:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:8335:x1869117117202304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529122.004089:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:8335:x1869117117202304:12345-0@lo:502:llog_process_th.0 Request processed in 510us (5936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529122.004098:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782529122.006649:0:8335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8335:1869117117202304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782529122.006702:0:8335:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782529122.006713:0:8335:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529122.006715:0:8335:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782529122.006720:0:8335:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1782529122.007041:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1782529122.007060:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782529122.007072:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529122.007082:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529122.007093:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782529122.007095:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff99c6457b19c0 from 1 10000000:01000000:0.0:1782529122.007098:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782529122.007130:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529122.007138:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529122.007147:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529122.007171:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117202432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782529122.007246:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529122.007300:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529122.007465:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117202432 00000100:00100000:2.0:1782529122.007472:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117202432 00000100:00100000:2.0:1782529122.007519:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782529122.007529:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117202432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529122.007541:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529122.007553:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eabb86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabb7f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529122.007586:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eabb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb7f expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529122.007596:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eabb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabb7f expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529122.007605:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00000, rc 0) 00000100:00100000:2.0:1782529122.007644:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117202432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529122.007651:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782529122.007955:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117202432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529122.007968:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb86 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529122.007978:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb86 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529122.008035:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117202560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529122.008063:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529122.008088:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529122.008101:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117202560 00000100:00100000:0.0:1782529122.008104:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117202560 00000100:00100000:0.0:1782529122.008123:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782529122.008129:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117202560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529122.008787:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117202560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 655us (720us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782529122.008796:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782529122.009310:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117202560:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1782529122.009344:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782529122.009353:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb86 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529122.009361:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb86 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529122.760508:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529123.399266:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117202816:0@lo:400:kworker.0 00000100:00100000:2.0:1782529123.399345:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529123.399416:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117203328:0@lo:400:kworker.0 00000100:00100000:2.0:1782529123.399442:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529123.399469:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782529123.399475:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117202944:0@lo:400:kworker.0 00000100:00100000:2.0:1782529123.399496:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529123.399512:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117203456:0@lo:400:kworker.0 00000100:00100000:2.0:1782529123.399534:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529123.399563:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117203328 00000100:00100000:2.0:1782529123.399572:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117203328 00000100:00100000:2.0:1782529123.399627:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117202944 00000100:00100000:2.0:1782529123.399630:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117202944 00000100:00100000:2.0:1782529123.399653:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529123.399662:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117203328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529123.399736:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117203328:12345-0@lo:400:kworker.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529123.399743:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529123.399759:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782529123.399777:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117202944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529123.399805:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117202944:12345-0@lo:400:kworker.0 Request processed in 41us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529123.399811:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782529123.399857:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117203456 00000100:00100000:2.0:1782529123.399861:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117203456 00000100:00100000:2.0:1782529123.399884:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529123.399891:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117203456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529123.399922:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117203456:12345-0@lo:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529123.399928:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1782529123.399945:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782529123.399949:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529123.399983:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117202944:0@lo:400:kworker.0 00010000:00080000:2.0:1782529123.399996:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae7100 x1869117117203456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529123.400006:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117203456:0@lo:400:kworker.0 00000100:00100000:2.0:1782529123.400014:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117203328:0@lo:400:kworker.0 00000100:00100000:3.0:1782529123.400224:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117202688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529123.400260:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529123.400292:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117203200:0@lo:400:kworker.0 00000100:00100000:3.0:1782529123.400314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529123.400331:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529123.400336:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117203072:0@lo:400:kworker.0 00000100:00100000:3.0:1782529123.400357:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529123.400397:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117203072 00000100:00100000:3.0:1782529123.400401:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117203072 00000100:00100000:3.0:1782529123.400430:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782529123.400437:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117203072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529123.400472:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117203072:12345-0@lo:400:kworker.0 Request processed in 35us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529123.400477:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1782529123.400491:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529123.400507:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117203072:0@lo:400:kworker.0 00000100:00100000:1.0:1782529123.400604:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117202816 00000100:00100000:1.0:1782529123.400609:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117202816 00000100:00100000:1.0:1782529123.400646:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782529123.400654:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117202816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529123.400690:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117202816:12345-0@lo:400:kworker.0 Request processed in 37us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529123.400696:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782529123.400823:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117203200 00000100:00100000:0.0:1782529123.400830:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117203200 00000100:00100000:0.0:1782529123.400889:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782529123.400897:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117203200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529123.400936:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117203200:12345-0@lo:400:kworker.0 Request processed in 40us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529123.400943:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1782529123.400977:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae7480 x1869117117203200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529123.401001:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117203200:0@lo:400:kworker.0 00000100:00080000:1.0:1782529123.401065:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529123.401988:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117202688 00000100:00100000:2.0:1782529123.401997:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117202688 00000100:00100000:2.0:1782529123.402046:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529123.402063:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117202688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529123.402096:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529123.402165:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117202688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529123.402172:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529123.402216:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117202816:0@lo:400:kworker.0 00010000:00080000:3.0:1782529123.402311:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677051f80 x1869117117202688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529123.402328:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117202688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782529123.783388:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529124.807098:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529125.714887:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529125.714939:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529125.715014:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108786048 00000100:00100000:3.0:1782529125.715023:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108786048 00000100:00100000:3.0:1782529125.715098:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:3.0:1782529125.715109:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108786048:12345-192.168.202.50@tcp:400: 00000100:00100000:3.0:1782529125.715205:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108786048:12345-192.168.202.50@tcp:400: Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529125.715213:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:0.0:1782529125.715645:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108786304 00000100:00100000:0.0:1782529125.715650:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108786304 00000100:00100000:0.0:1782529125.715684:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:0.0:1782529125.715692:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108786304:12345-192.168.202.50@tcp:400: 00000100:00100000:0.0:1782529125.715733:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108786304:12345-192.168.202.50@tcp:400: Request processed in 42us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529125.715740:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00080000:1.0:1782529125.715863:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782529125.715868:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529125.716240:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529125.716266:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529125.716341:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108786176 00000100:00100000:0.0:1782529125.716347:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108786176 00000100:00080000:1.0:1782529125.716479:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529125.716578:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:2.0:1782529125.716588:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108786176:12345-192.168.202.50@tcp:400: 00000100:00100000:2.0:1782529125.716640:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108786176:12345-192.168.202.50@tcp:400: Request processed in 54us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529125.716647:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:3.0:1782529125.716955:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108785920 00000100:00100000:3.0:1782529125.716960:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108785920 00000100:00100000:3.0:1782529125.717028:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:3.0:1782529125.717036:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:2343:x1869117108785920:12345-192.168.202.50@tcp:400: 00000100:00100000:3.0:1782529125.717295:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:2343:x1869117108785920:12345-192.168.202.50@tcp:400: Request processed in 259us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529125.717303:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 165 00010000:00010000:2.0:1782529125.831718:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529125.959949:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117203584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529125.960028:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529125.960150:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117203584 00000100:00100000:1.0:1782529125.960159:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117203584 00000100:00100000:1.0:1782529125.960239:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782529125.960249:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117203584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782529125.960283:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782529125.960386:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529125.967574:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117203584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7315us (7535us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529125.967591:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1782529125.972399:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b0b480 x1869117117203584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529125.972431:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117203584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529126.222804:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529126.223027:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108786432 00000100:00100000:3.0:1782529126.223037:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108786432 00000100:00100000:3.0:1782529126.223135:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:3.0:1782529126.223146:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:5561:x1869117108786432:12345-192.168.202.50@tcp:101: 00010000:00010000:3.0:1782529126.223163:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529126.223181:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c65972a400/0x72bfdc08f7eabb8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adce8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529126.223209:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c65972a400/0x72bfdc08f7eabb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adce8 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529126.223222:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c65972a400/0x72bfdc08f7eabb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adce8 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529126.223230:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972a400, rc 0) 00000100:00100000:3.0:1782529126.223291:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5561:x1869117108786432:12345-192.168.202.50@tcp:101: Request processed in 148us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529126.223311:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:0.0:1782529126.225857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529126.225902:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108786560 00000100:00100000:3.0:1782529126.225911:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108786560 00000100:00100000:3.0:1782529126.226014:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 167 00000100:00100000:3.0:1782529126.226024:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5561:x1869117108786560:12345-192.168.202.50@tcp:501: 00000100:00100000:3.0:1782529126.226330:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5561:x1869117108786560:12345-192.168.202.50@tcp:501: Request processed in 306us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529126.226338:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 167 00000100:00100000:2.0:1782529126.230126:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529126.230263:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108786688 00000100:00100000:3.0:1782529126.230274:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108786688 00000100:00100000:3.0:1782529126.230515:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:3.0:1782529126.230526:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5561:x1869117108786688:12345-192.168.202.50@tcp:503: 00000100:00100000:3.0:1782529126.231216:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5561:x1869117108786688:12345-192.168.202.50@tcp:503: Request processed in 691us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529126.231225:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:2.0:1782529126.238663:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529126.238769:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108786816 00000100:00100000:3.0:1782529126.238778:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108786816 00000100:00100000:3.0:1782529126.238846:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 169 00000100:00100000:3.0:1782529126.238856:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:6058:x1869117108786816:12345-192.168.202.50@tcp:502: 00000100:00100000:3.0:1782529126.239201:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:6058:x1869117108786816:12345-192.168.202.50@tcp:502: Request processed in 345us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529126.239210:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 169 00000100:00100000:0.0:1782529126.251807:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529126.251924:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108786944 00000100:00100000:1.0:1782529126.251934:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108786944 00000100:00100000:1.0:1782529126.251990:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 170 00000100:00100000:1.0:1782529126.251999:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:6058:x1869117108786944:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782529126.252257:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:6058:x1869117108786944:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 258us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529126.252265:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 170 00000100:00100000:1.0:1782529126.257449:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529126.257550:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108787072 00000100:00100000:3.0:1782529126.257561:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108787072 00000100:00100000:3.0:1782529126.257620:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00100000:3.0:1782529126.257658:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5561:x1869117108787072:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529126.257676:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529126.257694:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabb94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adcef expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529126.257721:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcef expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529126.257732:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcef expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529126.257751:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972a200, rc 0) 00000100:00100000:3.0:1782529126.257813:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5561:x1869117108787072:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529126.257821:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00100000:3.0:1782529126.263758:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529126.263929:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108787200 00000100:00100000:2.0:1782529126.263939:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108787200 00000100:00100000:2.0:1782529126.263996:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:2.0:1782529126.264005:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5561:x1869117108787200:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529126.264295:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5561:x1869117108787200:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 281us (545us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782529126.264304:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 172 00010000:00010000:2.0:1782529126.860866:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782529127.793166:0:8374:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed06d2760 20000000:00000080:0.0:1782529127.793186:0:8374:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99c646e87c00 uarg=0000000000000000 20000000:01000000:0.0:1782529127.793390:0:8374:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782529127.793396:0:8374:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782529127.793401:0:8374:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782529127.794978:0:8375:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1782529127.795217:0:8374:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1782529127.805164:0:8374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1782529127.805255:0:8374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1782529127.805408:0:8374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1782529127.805433:0:8374:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782529127.805470:0:8374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.805493:0:8374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640030c00/0x72bfdc08f7eab910 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.805504:0:8374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.805511:0:8374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.805522:0:8374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.805550:0:8374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.805601:0:8374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.805621:0:8374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 9 pid: 5787 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529127.805639:0:8374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1869117117203712:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529127.807336:0:8374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.807365:0:8374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 18 pid: 5789 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529127.807381:0:8374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1869117117203840:0@lo:104: 00000100:00100000:1.0:1782529127.807460:0:8374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782529127.807515:0:8374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.807524:0:8374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 18 pid: 5788 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529127.807534:0:8374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1869117117203968:0@lo:104: 00000100:00100000:1.0:1782529127.807560:0:8374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782529127.807589:0:8374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640030c00/0x72bfdc08f7eab910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.807611:0:8374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640030c00/0x72bfdc08f7eab910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 18 pid: 5787 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529127.807618:0:8374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1869117117204096:0@lo:104: 00000100:00100000:1.0:1782529127.807635:0:8374:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64608f000 going to sleep for 11 seconds 00000100:00100000:0.0:1782529127.808021:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782529127.808071:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529127.808102:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117203840 00000100:00100000:0.0:1782529127.808112:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117203840 00000100:00100000:0.0:1782529127.808153:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117203968 00000100:00100000:0.0:1782529127.808156:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117203968 00000100:00100000:0.0:1782529127.808167:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117204096 00000100:00100000:0.0:1782529127.808170:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117204096 00000100:00100000:0.0:1782529127.808183:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782529127.808192:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+5:8374:x1869117117203840:12345-0@lo:104: 00010000:00010000:0.0:1782529127.808219:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808284:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782529127.808291:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+5:8374:x1869117117203840:12345-0@lo:104: Request processed in 100us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529127.808298:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782529127.808315:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782529127.808321:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+4:8374:x1869117117203968:12345-0@lo:104: 00010000:00010000:0.0:1782529127.808328:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808375:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782529127.808380:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+4:8374:x1869117117203968:12345-0@lo:104: Request processed in 60us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529127.808386:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782529127.808416:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782529127.808422:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:8374:x1869117117204096:12345-0@lo:104: 00010000:00010000:0.0:1782529127.808429:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808454:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782529127.808458:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:8374:x1869117117204096:12345-0@lo:104: Request processed in 37us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529127.808463:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1782529127.808484:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782529127.808490:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808503:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b200 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529127.808507:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808516:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529127.808522:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529127.808526:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782529127.808561:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808567:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529127.808588:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808595:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972b200/0x72bfdc08f7eaba36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaba3d expref: -99 pid: 7490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808606:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782529127.808609:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808615:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577a00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529127.808617:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808633:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529127.808638:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529127.808643:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782529127.808656:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808661:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529127.808678:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808684:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c64a577a00/0x72bfdc08f7eab96b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab972 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808693:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529127.808696:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808700:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577c00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529127.808703:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808709:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529127.808714:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529127.808740:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782529127.808755:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808761:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529127.808767:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808772:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c64a577c00/0x72bfdc08f7eab909 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eab910 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.808784:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529127.808786:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529127.808788:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529127.808795:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529127.808826:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117204224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529127.808885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529127.808948:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117204352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529127.808971:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529127.808991:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529127.808995:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117204480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529127.809019:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529127.809055:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117204224 00000100:00100000:0.0:1782529127.809060:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117204224 00010000:00010000:0.0:1782529127.809081:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 19 pid: 5789 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529127.809103:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117204352 00000100:00100000:0.0:1782529127.809113:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117204352 00010000:00010000:0.0:1782529127.809125:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 20 pid: 5788 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529127.809136:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117204480 00000100:00100000:0.0:1782529127.809138:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117204480 00010000:00010000:0.0:1782529127.809150:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640030c00/0x72bfdc08f7eab910 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 21 pid: 5787 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529127.809162:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782529127.809167:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+21:3297:x1869117117204224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782529127.809177:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529127.809182:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 21 pid: 5789 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.809190:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 21 pid: 5789 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.809206:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529127.809230:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+21:3297:x1869117117204224:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529127.809236:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782529127.809248:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782529127.809253:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+20:3294:x1869117117204352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782529127.809259:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529127.809263:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 20 pid: 5788 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.809270:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 20 pid: 5788 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.809289:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529127.809315:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+20:3294:x1869117117204352:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529127.809321:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782529127.809333:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782529127.809339:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117204480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782529127.809345:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529127.809349:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640030c00/0x72bfdc08f7eab910 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 19 pid: 5787 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.809357:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640030c00/0x72bfdc08f7eab910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 19 pid: 5787 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.809365:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529127.809384:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117204480:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529127.809390:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782529127.809432:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117204480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529127.809441:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117204352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529127.809465:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117204224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782529127.809768:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682045400/0x72bfdc08f7eaba3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eaba36 expref: 18 pid: 5789 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529127.809781:0:8374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1869117117203840:0@lo:104: 00010000:00010000:1.0:1782529127.809792:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682044600/0x72bfdc08f7eab972 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab96b expref: 17 pid: 5788 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529127.809801:0:8374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1869117117203968:0@lo:104: 00010000:00010000:1.0:1782529127.809819:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030c00/0x72bfdc08f7eab910 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eab909 expref: 16 pid: 5787 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529127.809828:0:8374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1869117117204096:0@lo:104: 00000100:00100000:1.0:1782529127.812526:0:8374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1869117117203712:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529127.812606:0:8374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529127.817100:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529127.817256:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108787328 00000100:00100000:0.0:1782529127.817265:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108787328 00010000:00010000:0.0:1782529127.817308:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 10 pid: 5787 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529127.817349:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1782529127.817373:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2344:x1869117108787328:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529127.817388:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529127.817395:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 10 pid: 5787 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817410:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 10 pid: 5787 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817430:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabafa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb7 expref: 10 pid: 5787 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817449:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817457:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817475:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817482:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817489:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817495:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817501:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529127.817505:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817519:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817540:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529127.817550:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529127.817605:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:2344:x1869117108787328:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 234us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529127.817613:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00010000:00010000:1.0:1782529127.817677:0:8374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.817685:0:8374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.817702:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabb9b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529127.850992:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529127.856843:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108787456 00000100:00100000:1.0:1782529127.856855:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108787456 00000100:00100000:1.0:1782529127.856918:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:1.0:1782529127.856940:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:5561:x1869117108787456:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529127.856957:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529127.856976:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adcf6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.857003:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.857013:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529127.857021:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a576200, rc 0) 00000100:00100000:1.0:1782529127.857079:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5561:x1869117108787456:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 141us (6097us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529127.857086:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:0.0:1782529127.866284:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529127.866373:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108787584 00000100:00100000:3.0:1782529127.866382:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108787584 00000100:00100000:3.0:1782529127.866438:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:3.0:1782529127.866458:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5561:x1869117108787584:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529127.866774:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5561:x1869117108787584:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 327us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529127.866782:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:1.0:1782529127.868788:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529127.868888:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108787712 00000100:00100000:3.0:1782529127.868897:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108787712 00000100:00100000:3.0:1782529127.868949:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 175 00000100:00100000:3.0:1782529127.868958:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5561:x1869117108787712:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529127.869167:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:5561:x1869117108787712:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 209us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529127.869176:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 175 00000100:00100000:0.0:1782529127.882298:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529127.882364:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108787840 00000100:00100000:1.0:1782529127.882374:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108787840 00000100:00100000:1.0:1782529127.882436:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 176 00000100:00100000:1.0:1782529127.882447:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:6075:x1869117108787840:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782529127.882704:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:6075:x1869117108787840:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 257us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529127.882712:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 176 00010000:00010000:2.0:1782529127.883682:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529127.894016:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529127.894059:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108787968 00000100:00100000:3.0:1782529127.894068:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108787968 00000100:00100000:3.0:1782529127.894114:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 177 00000100:00100000:3.0:1782529127.894124:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:6075:x1869117108787968:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782529127.894359:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:6075:x1869117108787968:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 235us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529127.894368:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 177 00000100:00100000:3.0:1782529128.518986:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529128.519012:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117204608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529128.519096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529128.519167:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117204608 00000100:00100000:3.0:1782529128.519175:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117204608 00000100:00100000:3.0:1782529128.519239:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782529128.519248:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117204608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529128.519284:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529128.519340:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117204608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529128.519347:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1782529128.519368:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782529128.519393:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb61180 x1869117117204608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529128.519411:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117204608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529128.520117:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117204864:0@lo:400:kworker.0 00000100:00100000:3.0:1782529128.520153:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529128.520176:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782529128.520181:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117204992:0@lo:400:kworker.0 00000100:00100000:3.0:1782529128.520201:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529128.520235:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117204864 00000100:00100000:3.0:1782529128.520239:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117204864 00000100:00100000:3.0:1782529128.520263:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117204992 00000100:00100000:3.0:1782529128.520266:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117204992 00000100:00100000:3.0:1782529128.520290:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782529128.520296:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117204864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529128.520459:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117205120:0@lo:400:kworker.0 00000100:00100000:2.0:1782529128.520518:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117204736:0@lo:400:kworker.0 00000100:00100000:1.0:1782529128.520974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529128.521861:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529128.521905:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117205248:0@lo:400:kworker.0 00000100:00100000:2.0:1782529128.521939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529128.521980:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117204736 00000100:00100000:2.0:1782529128.521986:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117204736 00000100:00100000:2.0:1782529128.522024:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782529128.522032:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3297:x1869117117204736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529128.522096:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3297:x1869117117204736:12345-0@lo:400:kworker.0 Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529128.522103:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782529128.522133:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117205248 00000100:00100000:2.0:1782529128.522136:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117205248 00000100:00100000:2.0:1782529128.522161:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782529128.522168:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117205248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529128.522204:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117205248:12345-0@lo:400:kworker.0 Request processed in 37us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529128.522211:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782529128.522247:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117204736:0@lo:400:kworker.0 00010000:00080000:2.0:1782529128.522260:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb63480 x1869117117205248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529128.522269:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117205248:0@lo:400:kworker.0 00000100:00100000:3.0:1782529128.533167:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117204864:12345-0@lo:400:kworker.0 Request processed in 12860us (13002us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529128.533183:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782529128.533218:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117205120 00000100:00100000:3.0:1782529128.533227:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117205120 00000100:00100000:3.0:1782529128.533272:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782529128.533280:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117204992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529128.533375:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117204992:12345-0@lo:400:kworker.0 Request processed in 96us (13173us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529128.533381:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782529128.533394:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782529128.533400:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117205120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529128.533448:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117205120:12345-0@lo:400:kworker.0 Request processed in 48us (12474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529128.533453:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782529128.533526:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117205120:0@lo:400:kworker.0 00000100:00080000:3.0:1782529128.533556:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782529128.533563:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529128.533582:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117204992:0@lo:400:kworker.0 00000100:00100000:3.0:1782529128.533596:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117204864:0@lo:400:kworker.0 00010000:00010000:0.0:1782529128.903101:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782529129.161247:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782529129.161264:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c67f60f000 from 4 10000000:01000000:3.0:1782529129.161269:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782529129.161315:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.161338:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.161349:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529129.161376:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117205376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.161447:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.161496:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853e540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529129.161647:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117205376 00000100:00100000:0.0:1782529129.161655:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117205376 00000100:00100000:0.0:1782529129.161709:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782529129.161728:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117205376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529129.161741:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529129.161753:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabba9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529129.161776:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529129.161787:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529129.161795:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031c00, rc 0) 00000100:00100000:0.0:1782529129.161870:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117205376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529129.161878:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782529129.162080:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117205376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529129.162095:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.162104:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529129.162158:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117205504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.162190:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.162212:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853e540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529129.162420:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117205504 00000100:00100000:2.0:1782529129.162425:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117205504 00000100:00100000:2.0:1782529129.162460:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1782529129.162467:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117205504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529129.162738:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117205504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529129.162746:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782529129.163266:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117205504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.163303:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117205632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.163476:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.163510:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853e540 going to sleep for 11 seconds 00000100:00100000:0.0:1782529129.163550:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117205632 00000100:00100000:0.0:1782529129.163555:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117205632 00000100:00100000:0.0:1782529129.163591:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1782529129.163598:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117205632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529129.163781:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117205632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529129.163788:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782529129.165544:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117205632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.167697:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8429:1869117117205760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529129.167796:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.167861:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782529129.167947:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117205760 00000100:00100000:2.0:1782529129.167955:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117205760 00000100:00100000:2.0:1782529129.168007:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782529129.168019:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+17:8429:x1869117117205760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529129.168266:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+17:8429:x1869117117205760:12345-0@lo:502:llog_process_th.0 Request processed in 236us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529129.168275:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782529129.169699:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8429:1869117117205760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782529129.169755:0:8429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529129.169766:0:8429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529129.169768:0:8429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782529129.169775:0:8429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c67f60f000 00000020:00000080:3.0:1782529129.169778:0:8429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782529129.169898:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8429:1869117117205888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529129.169958:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.169992:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529129.170078:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117205888 00000100:00100000:1.0:1782529129.170086:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117205888 00000100:00100000:1.0:1782529129.170125:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782529129.170134:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:8429:x1869117117205888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529129.171440:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:8429:x1869117117205888:12345-0@lo:502:llog_process_th.0 Request processed in 1301us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529129.171451:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782529129.171637:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8429:1869117117205888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782529129.171672:0:8429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529129.171679:0:8429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529129.171682:0:8429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782529129.171687:0:8429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782529129.174490:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782529129.174527:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782529129.174540:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529129.174555:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529129.174567:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782529129.174570:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c6795ce000 from 4 10000000:01000000:1.0:1782529129.174574:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529129.174624:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529129.174644:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529129.174655:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529129.174681:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529129.174756:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529129.174793:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648572cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.174939:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117206016 00000100:00100000:3.0:1782529129.174947:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117206016 00000100:00100000:3.0:1782529129.174993:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782529129.175008:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117206016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529129.175022:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529129.175033:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabbb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.175067:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.175077:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.175086:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972ac00, rc 0) 00000100:00100000:3.0:1782529129.175127:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117206016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.175134:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782529129.175191:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529129.175203:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.175212:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529129.175273:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.175297:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.175312:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.175551:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117206144 00000100:00100000:3.0:1782529129.175556:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117206144 00000100:00100000:3.0:1782529129.175581:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782529129.175596:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117206144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.175948:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117206144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.175955:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782529129.175992:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.176023:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.178944:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.178991:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.179016:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117206272 00000100:00100000:3.0:1782529129.179022:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117206272 00000100:00100000:3.0:1782529129.179068:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782529129.179076:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117206272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.179296:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117206272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.179304:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782529129.181520:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.181774:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8431:1869117117206400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529129.181900:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.181932:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117206400 00000100:00100000:3.0:1782529129.181938:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117206400 00000100:00100000:3.0:1782529129.181977:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782529129.181988:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:8431:x1869117117206400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529129.182204:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:8431:x1869117117206400:12345-0@lo:502:llog_process_th.0 Request processed in 218us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.182222:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782529129.183446:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853e240 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.183477:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8431:1869117117206400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782529129.183515:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529129.183526:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529129.183528:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782529129.183536:0:8431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c6795ce000 00000020:00000080:3.0:1782529129.183539:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782529129.183640:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8431:1869117117206528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529129.183698:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.183737:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117206528 00000100:00100000:3.0:1782529129.183742:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117206528 00000100:00100000:3.0:1782529129.183776:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782529129.183783:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:8431:x1869117117206528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529129.183952:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:8431:x1869117117206528:12345-0@lo:502:llog_process_th.0 Request processed in 170us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.183959:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782529129.183992:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64853e240 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.184003:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8431:1869117117206528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782529129.184018:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529129.184023:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529129.184024:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782529129.184027:0:8431:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782529129.184074:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782529129.184094:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782529129.184105:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.184120:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529129.184130:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782529129.184133:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c646a6f800 from 4 10000000:01000000:3.0:1782529129.184136:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782529129.184156:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.184164:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.184173:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529129.184186:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.184209:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.184221:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc600 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.184232:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117206656 00000100:00100000:3.0:1782529129.184236:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117206656 00000100:00100000:3.0:1782529129.184255:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1782529129.184259:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117206656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529129.184267:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529129.184277:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabbc5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.184296:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.184316:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.184945:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972be00, rc 0) 00000100:00100000:3.0:1782529129.184994:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117206656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 731us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.185001:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1782529129.185046:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529129.185060:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.185070:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529129.185126:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.185159:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.185174:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc600 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.185189:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117206784 00000100:00100000:3.0:1782529129.185193:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117206784 00000100:00100000:3.0:1782529129.185218:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782529129.185225:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117206784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.185626:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117206784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 401us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.185634:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782529129.185672:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.185711:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.185765:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529129.185778:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645adc600 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.185790:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117206912 00000100:00100000:3.0:1782529129.185793:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117206912 00000100:00100000:3.0:1782529129.185812:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1782529129.185818:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117206912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529129.185964:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117206912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.185971:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1782529129.186006:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117206912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529129.187110:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8432:1869117117207040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529129.187165:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529129.187224:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648572d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529129.187389:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117207040 00000100:00100000:3.0:1782529129.187395:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117207040 00000100:00100000:3.0:1782529129.187462:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1782529129.187469:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:8432:x1869117117207040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529129.187656:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:8432:x1869117117207040:12345-0@lo:502:llog_process_th.0 Request processed in 187us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529129.187664:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1782529129.188082:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8432:1869117117207040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782529129.188112:0:8432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529129.188121:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529129.188124:0:8432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782529129.188132:0:8432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c646a6f800 00000020:00000080:1.0:1782529129.188135:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782529129.188218:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8432:1869117117207168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529129.188396:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529129.188423:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117207168 00000100:00100000:1.0:1782529129.188427:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117207168 00000100:00100000:1.0:1782529129.188451:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1782529129.188459:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:8432:x1869117117207168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529129.188593:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:8432:x1869117117207168:12345-0@lo:502:llog_process_th.0 Request processed in 135us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529129.188685:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1782529129.188925:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648572d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529129.188945:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:8432:1869117117207168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782529129.188966:0:8432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529129.188972:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529129.188973:0:8432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782529129.188977:0:8432:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782529129.189139:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782529129.189156:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782529129.189165:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529129.189174:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529129.927154:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529130.845402:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529130.845452:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529130.845483:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529130.845504:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529130.845545:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108788352 00000100:00100000:1.0:1782529130.845558:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108788352 00000100:00100000:1.0:1782529130.845646:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108788480 00000100:00100000:1.0:1782529130.845649:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108788480 00000100:00100000:1.0:1782529130.845670:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:1.0:1782529130.845682:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2342:x1869117108788352:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529130.845787:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2342:x1869117108788352:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 107us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529130.845795:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:1.0:1782529130.845812:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1782529130.845817:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2342:x1869117108788480:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529130.845879:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2342:x1869117108788480:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 61us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529130.845885:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:3.0:1782529130.846259:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108788096 00000100:00100000:3.0:1782529130.846265:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108788096 00000100:00100000:3.0:1782529130.846318:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 194 00000100:00100000:3.0:1782529130.846325:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108788096:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529130.846358:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108788096:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 34us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529130.846364:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 194 00000100:00100000:3.0:1782529130.846394:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108788224 00000100:00100000:3.0:1782529130.846397:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108788224 00000100:00080000:1.0:1782529130.846510:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782529130.846515:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782529130.846518:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529130.847028:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:3.0:1782529130.847041:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108788224:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529130.847087:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108788224:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 51us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529130.847094:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00010000:00010000:0.0:1782529130.951287:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529131.084366:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117207296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782529131.084479:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529131.090901:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117207296 00000100:00100000:3.0:1782529131.090923:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117207296 00000100:00100000:3.0:1782529131.091934:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782529131.091963:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117207296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529131.092042:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529131.092163:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117207296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 217us (7684us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529131.092171:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1782529131.092260:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdaa00 x1869117117207296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529131.092289:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117207296:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782529131.098878:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782529131.975182:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529133.000267:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529133.640313:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117207808:0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.640381:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529133.640438:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782529133.640445:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117207424:0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.640471:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529133.640493:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117207936:0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.640515:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529133.640541:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117207552:0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.640564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529133.640581:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117208064:0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.640624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529133.640651:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782529133.640656:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117207680:0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.640688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529133.640720:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117207808 00000100:00100000:3.0:1782529133.640728:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117207808 00000100:00100000:3.0:1782529133.640782:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117208064 00000100:00100000:3.0:1782529133.640785:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117208064 00000100:00100000:3.0:1782529133.640805:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782529133.640812:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117207808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.640880:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117207808:12345-0@lo:400:kworker.0 Request processed in 68us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529133.640886:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782529133.640910:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782529133.640916:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117208064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529133.641310:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117208192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529133.641313:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117207936 00000100:00100000:0.0:1782529133.641316:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117207936 00000100:00100000:0.0:1782529133.641343:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117207552 00000100:00100000:0.0:1782529133.641346:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117207552 00000100:00100000:0.0:1782529133.641356:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117207680 00000100:00100000:0.0:1782529133.641358:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117207680 00000100:00100000:0.0:1782529133.641372:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782529133.641377:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117207936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529133.642091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529133.642151:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117208192 00000100:00100000:2.0:1782529133.642162:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117208192 00000100:00100000:2.0:1782529133.642195:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782529133.642201:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117208192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529133.642230:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529133.642270:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117208192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529133.642277:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1782529133.642317:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cd9f80 x1869117117208192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529133.642337:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117208192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529133.642502:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117208064:12345-0@lo:400:kworker.0 Request processed in 1585us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529133.642510:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782529133.642533:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117207424 00000100:00100000:3.0:1782529133.642538:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117207424 00000100:00100000:3.0:1782529133.642575:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782529133.642591:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117207424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.642623:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117207424:12345-0@lo:400:kworker.0 Request processed in 34us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529133.642629:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782529133.642794:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782529133.642803:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117207552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.642908:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117207552:12345-0@lo:400:kworker.0 Request processed in 107us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529133.642914:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782529133.643035:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782529133.643046:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117207680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529133.643078:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117207680:12345-0@lo:400:kworker.0 Request processed in 35us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529133.643084:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1782529133.643111:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782529133.643116:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782529133.643118:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529133.643158:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117207424:0@lo:400:kworker.0 00010000:00080000:3.0:1782529133.643183:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb61180 x1869117117207808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529133.643192:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117207808:0@lo:400:kworker.0 00000100:00100000:2.0:1782529133.644152:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117207680:0@lo:400:kworker.0 00000100:00100000:2.0:1782529133.644168:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117207552:0@lo:400:kworker.0 00010000:00080000:2.0:1782529133.644180:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdd880 x1869117117208064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529133.644191:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117208064:0@lo:400:kworker.0 00000100:00100000:0.0:1782529133.649944:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117207936:12345-0@lo:400:kworker.0 Request processed in 8553us (9415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529133.649961:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782529133.650196:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117207936:0@lo:400:kworker.0 00010000:00010000:1.0:1782529134.024005:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782529134.351108:0:8673:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1782529135.048759:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529135.969899:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529135.970003:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529135.970035:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529135.970118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529135.970247:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108788736 00000100:00100000:3.0:1782529135.970259:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108788736 00000100:00100000:3.0:1782529135.970348:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:3.0:1782529135.970359:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108788736:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529135.970432:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108788736:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 75us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529135.970439:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:3.0:1782529135.970462:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108788864 00000100:00100000:3.0:1782529135.970466:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108788864 00000100:00100000:3.0:1782529135.970490:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108788992 00000100:00100000:3.0:1782529135.970493:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108788992 00000100:00100000:3.0:1782529135.970511:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1782529135.970517:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2340:x1869117108788864:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:3.0:1782529135.970544:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabb08 00000100:00080000:3.0:1782529135.970555:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c677944000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782529135.970590:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782529135.970981:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+2:2340:x1869117108788864:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 462us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529135.970989:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1782529135.971003:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:3.0:1782529135.971025:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2340:x1869117108788992:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:3.0:1782529135.971041:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabb0f 00000100:00080000:3.0:1782529135.971048:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c677943800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782529135.971071:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782529135.971255:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+2:2340:x1869117108788992:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 231us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529135.971262:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00010000:00010000:3.0:1782529135.971374:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529135.971381:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782529135.971921:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782529135.971926:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782529135.971942:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529135.983250:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108788608 00000100:00100000:1.0:1782529135.983273:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108788608 00000100:00100000:0.0:1782529135.983452:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 196 00000100:00100000:0.0:1782529135.983463:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2343:x1869117108788608:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529135.983550:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2343:x1869117108788608:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 89us (13664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529135.983571:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 196 00010000:00010000:3.0:1782529136.076406:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529136.199003:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782529136.199029:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117208320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529136.199107:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529136.199193:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117208320 00000100:00100000:2.0:1782529136.199203:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117208320 00000100:00100000:3.0:1782529136.199340:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782529136.199350:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117208320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529136.199385:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529136.199432:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117208320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529136.199440:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1782529136.199478:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677053100 x1869117117208320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529136.199496:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117208320:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782529136.199770:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1782529136.843606:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:1.0:1782529136.843618:0:6618:0:(genops.c:906:class_export_put()) final put ffff99c677945800/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:0.0:1782529136.843700:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c677945800/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 for lustre-OST0000 00000020:00000080:0.0:1782529136.843766:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c677944000 for lustre-OST0000 00010000:00010000:3.0:1782529137.094998:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529138.119985:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529138.770659:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117208448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529138.770734:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529138.770825:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117208448 00000100:00100000:3.0:1782529138.770998:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117208448 00000100:00100000:2.0:1782529138.772370:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117208576:0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.772447:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529138.772491:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117209088:0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.772519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529138.772546:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529138.772552:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117208704:0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.772578:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529138.772613:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117208576 00000100:00100000:2.0:1782529138.772619:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117208576 00000100:00100000:2.0:1782529138.772680:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782529138.772688:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3296:x1869117117208576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.772740:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3296:x1869117117208576:12345-0@lo:400:kworker.0 Request processed in 52us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529138.772748:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782529138.772785:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117208704 00000100:00100000:2.0:1782529138.772788:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117208704 00000100:00100000:2.0:1782529138.772814:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782529138.772820:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117208704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.772868:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117208704:12345-0@lo:400:kworker.0 Request processed in 48us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529138.772874:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782529138.772907:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117208704:0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.772915:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117208576:0@lo:400:kworker.0 00000100:00100000:3.0:1782529138.773020:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782529138.773032:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117208448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529138.773068:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529138.773103:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117208448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529138.773110:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782529138.775451:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117208832:0@lo:400:kworker.0 00000100:00100000:0.0:1782529138.775537:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529138.775596:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529138.775604:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117208960:0@lo:400:kworker.0 00000100:00100000:0.0:1782529138.775625:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529138.777557:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117208832 00000100:00100000:2.0:1782529138.777571:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117208832 00000100:00100000:2.0:1782529138.777621:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117208960 00000100:00100000:2.0:1782529138.777625:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117208960 00000100:00100000:2.0:1782529138.777667:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782529138.777677:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117208832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.777773:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117208832:12345-0@lo:400:kworker.0 Request processed in 98us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529138.777781:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782529138.777799:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782529138.777805:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117208960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.777855:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117208960:12345-0@lo:400:kworker.0 Request processed in 27us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529138.777862:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782529138.777904:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117208960:0@lo:400:kworker.0 00000100:00100000:2.0:1782529138.777916:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117208832:0@lo:400:kworker.0 00000100:00080000:2.0:1782529138.779818:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782529138.779828:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782529138.779901:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae7100 x1869117117208448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529138.779929:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117208448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529138.782105:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117209088 00000100:00100000:3.0:1782529138.782120:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117209088 00000100:00100000:3.0:1782529138.782182:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782529138.782192:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117209088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782529138.782900:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529138.783011:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117209088:12345-0@lo:400:kworker.0 Request processed in 818us (10487us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529138.783022:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1782529138.783084:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae7b80 x1869117117209088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529138.783104:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117209088:0@lo:400:kworker.0 00000001:02000400:2.0:1782529138.834770:0:8917:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing yml_node 00010000:00010000:1.0:1782529139.144198:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529140.167747:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782529140.405982:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:0.0:1782529140.405992:0:7509:0:(genops.c:906:class_export_put()) final put ffff99c677941800/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:0.0:1782529140.406023:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c677941800/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 for lustre-OST0001 00000020:00000080:0.0:1782529140.406064:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c677943800 for lustre-OST0001 00000100:00100000:2.0:1782529141.078885:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529141.078948:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529141.079022:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108789248 00000100:00100000:0.0:1782529141.079033:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108789248 00000100:00100000:0.0:1782529141.079103:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:0.0:1782529141.079113:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108789248:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529141.079196:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108789248:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529141.079204:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:3.0:1782529141.079478:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108789120 00000100:00100000:3.0:1782529141.079482:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108789120 00000100:00100000:3.0:1782529141.079521:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 198 00000100:00100000:3.0:1782529141.079527:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108789120:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529141.079552:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108789120:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529141.079558:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 198 00000100:00080000:2.0:1782529141.080369:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782529141.191434:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529141.322289:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529141.322314:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117209216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529141.322388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529141.322553:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117209216 00000100:00100000:2.0:1782529141.322562:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117209216 00000100:00100000:3.0:1782529141.322663:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782529141.322685:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117209216:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782529141.322725:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1782529141.322741:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529141.322879:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117209216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (489us total) trans 0 rc 0/0 00010000:00080000:0.0:1782529141.322978:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f757100 x1869117117209216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529141.323008:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117209216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782529141.331470:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1782529142.215220:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529143.241098:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782529143.505118:0:9113:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.99 00000100:00100000:0.0:1782529143.880042:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117209344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529143.880177:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529143.880744:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117209344 00000100:00100000:2.0:1782529143.880756:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117209344 00000100:00100000:2.0:1782529143.880861:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782529143.880874:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117209344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529143.880939:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529143.881006:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117209344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529143.881014:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1782529143.881069:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f756680 x1869117117209344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529143.881091:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117209344:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782529143.881684:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529143.883737:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117209600:0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.883828:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529143.883908:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529143.883915:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117209728:0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.883938:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529143.883984:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117209600 00000100:00100000:2.0:1782529143.883992:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117209600 00000100:00100000:2.0:1782529143.884046:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117209728 00000100:00100000:2.0:1782529143.884049:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117209728 00000100:00100000:2.0:1782529143.884083:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782529143.884092:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117209600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884151:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117209600:12345-0@lo:400:kworker.0 Request processed in 60us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529143.884179:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782529143.884210:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782529143.884217:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117209728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884246:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117209728:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529143.884252:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1782529143.884283:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529143.884320:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117209728:0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884332:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117209600:0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884358:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117209856:0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884381:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529143.884403:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782529143.884408:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117209472:0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884451:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529143.884474:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117209984:0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884497:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529143.884523:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117209472 00000100:00100000:2.0:1782529143.884527:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117209472 00000100:00100000:2.0:1782529143.884562:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782529143.884568:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117209472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884612:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117209472:12345-0@lo:400:kworker.0 Request processed in 43us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529143.884618:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782529143.884650:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117209984 00000100:00100000:2.0:1782529143.884660:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117209984 00000100:00100000:2.0:1782529143.884694:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782529143.884701:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117209984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884732:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117209984:12345-0@lo:400:kworker.0 Request processed in 32us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529143.884738:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1782529143.884757:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529143.884765:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117209856 00000100:00100000:2.0:1782529143.884767:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117209856 00000100:00100000:2.0:1782529143.884791:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782529143.884796:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117209856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884824:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117209856:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529143.884855:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1782529143.884869:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529143.884886:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117209472:0@lo:400:kworker.0 00010000:00080000:2.0:1782529143.884900:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f755f80 x1869117117209984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529143.884912:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117209984:0@lo:400:kworker.0 00000100:00100000:2.0:1782529143.884921:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117209856:0@lo:400:kworker.0 00010000:00010000:1.0:1782529144.267958:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529145.289979:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782529146.114782:0:9210:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.99 00000100:00100000:2.0:1782529146.199708:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529146.201103:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529146.202002:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108789504 00000100:00100000:3.0:1782529146.202018:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108789504 00000100:00100000:3.0:1782529146.202103:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1782529146.202117:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108789504:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529146.202222:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108789504:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 108us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529146.202231:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00080000:2.0:1782529146.202423:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529146.204660:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108789376 00000100:00100000:0.0:1782529146.204677:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108789376 00000100:00100000:0.0:1782529146.204823:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 200 00000100:00100000:0.0:1782529146.204861:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108789376:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529146.204961:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108789376:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 129us (5269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529146.204970:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 200 00010000:00010000:0.0:1782529146.317302:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529146.439228:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782529146.441629:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117210112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529146.441780:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529146.442163:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117210112 00000100:00100000:2.0:1782529146.442174:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117210112 00000100:00080000:0.0:1782529146.442349:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529146.442371:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782529146.442402:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117210112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529146.442451:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529146.442527:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117210112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529146.442536:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1782529146.442597:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f755f80 x1869117117210112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529146.442616:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117210112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782529147.335338:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529148.359243:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782529148.937220:0:9308:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.99 00000100:00100000:1.0:1782529148.999927:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117210240:0@lo:400:kworker.0 00000100:00100000:1.0:1782529149.000040:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529149.004900:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117210368:0@lo:400:kworker.0 00000100:00100000:3.0:1782529149.005029:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529149.005107:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782529149.005116:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117210496:0@lo:400:kworker.0 00000100:00100000:3.0:1782529149.005145:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529149.005192:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117210368 00000100:00100000:3.0:1782529149.005202:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117210368 00000100:00100000:3.0:1782529149.005270:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117210496 00000100:00100000:3.0:1782529149.005274:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117210496 00000100:00100000:3.0:1782529149.005514:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782529149.005524:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117210368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529149.005608:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117210368:12345-0@lo:400:kworker.0 Request processed in 84us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529149.005617:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782529149.005641:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782529149.005649:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117210496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529149.005699:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117210496:12345-0@lo:400:kworker.0 Request processed in 51us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529149.005705:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782529149.005762:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117210496:0@lo:400:kworker.0 00000100:00100000:3.0:1782529149.005773:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117210368:0@lo:400:kworker.0 00000100:00100000:1.0:1782529149.006288:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117210752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529149.006434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529149.006461:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782529149.006468:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117210624:0@lo:400:kworker.0 00000100:00100000:1.0:1782529149.006506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529149.006547:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117210240 00000100:00100000:1.0:1782529149.006563:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117210240 00000100:00100000:1.0:1782529149.006601:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782529149.006608:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117210240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529149.006649:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117210240:12345-0@lo:400:kworker.0 Request processed in 40us (6610us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529149.006656:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1782529149.007100:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117210752 00000100:00100000:3.0:1782529149.007105:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117210752 00000100:00100000:3.0:1782529149.007155:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782529149.007163:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117210752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529149.007205:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529149.007269:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117210752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529149.007275:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782529149.008044:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117210624 00000100:00100000:3.0:1782529149.008053:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117210624 00000100:00100000:3.0:1782529149.008110:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782529149.008118:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117210624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529149.008176:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117210624:12345-0@lo:400:kworker.0 Request processed in 59us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529149.008183:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782529149.009407:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117210880:0@lo:400:kworker.0 00000100:00100000:3.0:1782529149.009480:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529149.011073:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117210880 00000100:00100000:3.0:1782529149.011100:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117210880 00000100:00100000:3.0:1782529149.011174:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782529149.011625:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782529149.011644:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117211008:0@lo:400:kworker.0 00000100:00100000:2.0:1782529149.011731:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529149.011785:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117211008 00000100:00100000:3.0:1782529149.011786:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117210880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529149.011793:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117211008 00000100:00100000:2.0:1782529149.011874:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782529149.011885:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117211008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529149.012102:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117211008:12345-0@lo:400:kworker.0 Request processed in 218us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529149.012111:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782529149.012132:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117210880:12345-0@lo:400:kworker.0 Request processed in 373us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529149.012147:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1782529149.012179:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f755500 x1869117117211008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529149.012198:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117211008:0@lo:400:kworker.0 00000100:00100000:2.0:1782529149.012215:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117210880:0@lo:400:kworker.0 00000100:00080000:2.0:1782529149.014440:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782529149.014452:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782529149.014457:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782529149.019219:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f755880 x1869117117210624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529149.019244:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117210624:0@lo:400:kworker.0 00010000:00080000:0.0:1782529149.019271:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdad80 x1869117117210752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529149.019303:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117210752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529149.019317:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117210240:0@lo:400:kworker.0 00010000:00010000:1.0:1782529149.383182:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529150.409579:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782529151.006275:0:9357:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jun 26 22:59:09 EDT 2026 00000100:00100000:3.0:1782529151.319066:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529151.319131:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529151.319173:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108789760 00000100:00100000:3.0:1782529151.319186:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108789760 00000100:00100000:3.0:1782529151.319274:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1782529151.319286:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108789760:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529151.319388:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108789760:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529151.319397:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00080000:2.0:1782529151.319801:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529151.320945:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108789632 00000100:00100000:0.0:1782529151.320965:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108789632 00000100:00100000:0.0:1782529151.321741:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 202 00000100:00100000:0.0:1782529151.321759:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108789632:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529151.321930:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108789632:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 163us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529151.321939:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 202 00010000:00010000:1.0:1782529151.431993:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529151.559434:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782529151.559471:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117211136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529151.559627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529151.560314:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117211136 00000100:00100000:3.0:1782529151.560326:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117211136 00000100:00100000:3.0:1782529151.560453:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782529151.560466:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117211136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529151.560520:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529151.560992:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117211136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 526us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529151.561003:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1782529151.564616:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782529151.566884:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f755c00 x1869117117211136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529151.566926:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117211136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782529152.456968:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529153.479318:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529154.119171:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117211264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529154.119279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529154.119432:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117211264 00000100:00100000:3.0:1782529154.119444:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117211264 00000100:00100000:3.0:1782529154.119542:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782529154.119554:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117211264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529154.119601:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782529154.119720:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529154.120446:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117211264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 890us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529154.120478:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782529154.120609:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117211392:0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.120688:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529154.120734:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117211904:0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.120766:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529154.120888:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782529154.120896:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117211520:0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.120925:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529154.120964:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117211648:0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.120991:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529154.121012:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529154.121018:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117211776:0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.121040:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529154.121084:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117211520 00000100:00100000:2.0:1782529154.121092:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117211520 00000100:00100000:0.0:1782529154.121230:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117211392 00000100:00100000:0.0:1782529154.121235:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117211392 00000100:00100000:0.0:1782529154.121276:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782529154.121284:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117211392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529154.121336:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117211392:12345-0@lo:400:kworker.0 Request processed in 53us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529154.121343:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782529154.121485:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117211648 00000100:00100000:2.0:1782529154.121490:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117211648 00000100:00100000:2.0:1782529154.121525:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117211776 00000100:00100000:2.0:1782529154.121528:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117211776 00000100:00100000:2.0:1782529154.121543:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782529154.121548:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117211520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.121582:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117211520:12345-0@lo:400:kworker.0 Request processed in 34us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529154.121588:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782529154.121602:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782529154.121607:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117211648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.121634:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117211648:12345-0@lo:400:kworker.0 Request processed in 27us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529154.121638:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782529154.121659:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782529154.121772:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117211776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.121805:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117211776:12345-0@lo:400:kworker.0 Request processed in 140us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529154.121811:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1782529154.121903:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529154.121946:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117211776:0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.121959:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117211648:0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.121994:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117211520:0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.122004:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117211392:0@lo:400:kworker.0 00000100:00100000:3.0:1782529154.123576:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117211904 00000100:00100000:3.0:1782529154.123593:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117211904 00000100:00100000:2.0:1782529154.124400:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782529154.124412:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117211904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529154.124536:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117211904:12345-0@lo:400:kworker.0 Request processed in 126us (3768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529154.124545:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1782529154.124606:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f755c00 x1869117117211904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529154.124623:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117211904:0@lo:400:kworker.0 00010000:00080000:1.0:1782529154.126822:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdad80 x1869117117211264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529154.126881:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117211264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782529154.127057:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529154.385234:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529154.385327:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529154.385455:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108790016 00000100:00100000:3.0:1782529154.385468:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108790016 00000100:00100000:3.0:1782529154.385564:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1782529154.385577:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108790016:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529154.385682:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108790016:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 107us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529154.385690:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00080000:2.0:1782529154.387352:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529154.395271:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108789888 00000100:00100000:0.0:1782529154.395293:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108789888 00000100:00100000:0.0:1782529154.395433:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 204 00000100:00100000:0.0:1782529154.395448:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108789888:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529154.395598:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2342:x1869117108789888:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 153us (10381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529154.395609:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 204 00010000:00010000:0.0:1782529154.506199:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529155.527299:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529156.551806:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529156.680060:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529156.680095:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117212032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529156.680259:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529156.686002:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117212032 00000100:00100000:1.0:1782529156.686024:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117212032 00000100:00100000:1.0:1782529156.687440:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782529156.687472:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117212032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782529156.687539:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529156.687666:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117212032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (7406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529156.687675:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1782529156.687722:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782529156.688264:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae5f80 x1869117117212032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529156.688294:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117212032:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782529157.576817:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529158.599251:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529159.239187:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117212160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529159.239271:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529159.239331:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117212160 00000100:00100000:1.0:1782529159.239340:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117212160 00000100:00080000:2.0:1782529159.239372:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529159.239392:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782529159.239401:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117212160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782529159.239437:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529159.239507:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117212160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529159.239514:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1782529159.239593:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cd9f80 x1869117117212160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529159.239612:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117212160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529159.242613:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c5410f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117212544:0@lo:400:kworker.0 00000100:00100000:3.0:1782529159.242708:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529159.242787:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782529159.242795:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c5410f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117212416:0@lo:400:kworker.0 00000100:00100000:3.0:1782529159.242819:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529159.242874:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117212544 00000100:00100000:3.0:1782529159.242882:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117212544 00000100:00100000:3.0:1782529159.242933:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117212416 00000100:00100000:3.0:1782529159.242936:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117212416 00000100:00100000:3.0:1782529159.242960:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782529159.242968:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117212544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529159.243031:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117212544:12345-0@lo:400:kworker.0 Request processed in 63us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529159.243038:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782529159.243053:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782529159.243058:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117212416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529159.243101:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117212416:12345-0@lo:400:kworker.0 Request processed in 42us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529159.243107:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1782529159.243132:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529159.243157:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c5410f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117212416:0@lo:400:kworker.0 00000100:00100000:3.0:1782529159.243166:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c5410f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117212544:0@lo:400:kworker.0 00000100:00100000:2.0:1782529159.243606:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c5410f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117212672:0@lo:400:kworker.0 00000100:00100000:2.0:1782529159.243642:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529159.243673:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782529159.243679:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c5410f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117212288:0@lo:400:kworker.0 00000100:00100000:2.0:1782529159.243704:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529159.243746:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c5410f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117212800:0@lo:400:kworker.0 00000100:00100000:2.0:1782529159.243772:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529159.243801:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117212288 00000100:00100000:2.0:1782529159.243806:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117212288 00000100:00100000:2.0:1782529159.243858:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782529159.243866:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3296:x1869117117212288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529159.243902:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3296:x1869117117212288:12345-0@lo:400:kworker.0 Request processed in 37us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529159.243908:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782529159.243938:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117212800 00000100:00100000:2.0:1782529159.243942:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117212800 00000100:00100000:2.0:1782529159.243974:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782529159.243982:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117212800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529159.244025:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117212800:12345-0@lo:400:kworker.0 Request processed in 44us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529159.244031:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1782529159.244048:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529159.244077:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c5410f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117212288:0@lo:400:kworker.0 00010000:00080000:2.0:1782529159.244090:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c5410f4a80 x1869117117212800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529159.244100:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c5410f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117212800:0@lo:400:kworker.0 00000100:00100000:3.0:1782529159.244401:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117212672 00000100:00100000:3.0:1782529159.244406:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117212672 00000100:00100000:3.0:1782529159.244447:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782529159.244454:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117212672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529159.244506:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117212672:12345-0@lo:400:kworker.0 Request processed in 52us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529159.244513:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1782529159.244578:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529159.244600:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c5410f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117212672:0@lo:400:kworker.0 00000100:00100000:2.0:1782529159.507983:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529159.508096:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108790144 00000100:00100000:0.0:1782529159.508105:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108790144 00000100:00100000:0.0:1782529159.508160:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 206 00000100:00100000:0.0:1782529159.508170:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2343:x1869117108790144:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529159.508262:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2343:x1869117108790144:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 93us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529159.508270:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 206 00000100:00100000:2.0:1782529159.515603:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529159.515864:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108790272 00000100:00100000:3.0:1782529159.515874:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108790272 00000100:00100000:3.0:1782529159.515955:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:3.0:1782529159.515966:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108790272:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529159.516055:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108790272:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 91us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529159.516063:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00080000:2.0:1782529159.516338:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782529159.631434:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529160.646925:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529161.671110:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529161.799356:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117212928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529161.799435:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529161.799625:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117212928 00000100:00100000:2.0:1782529161.799635:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117212928 00000100:00080000:0.0:1782529161.799715:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529161.805042:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782529161.805066:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117212928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782529161.805104:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529161.805177:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117212928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (5743us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529161.805182:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1782529161.805301:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae4700 x1869117117212928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529161.805317:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117212928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782529162.695033:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529163.724070:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529164.362201:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117213440:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.362275:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529164.362327:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782529164.362334:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117213056:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.362364:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529164.362387:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117213568:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.362411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529164.362452:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117213184:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.362475:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529164.362494:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117213696:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.362515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529164.362532:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529164.362537:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117213312:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.362569:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529164.362604:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117213440 00000100:00100000:2.0:1782529164.362612:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117213440 00000100:00100000:2.0:1782529164.362663:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117213696 00000100:00100000:2.0:1782529164.362667:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117213696 00000100:00100000:2.0:1782529164.362688:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529164.362696:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117213440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.362746:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117213440:12345-0@lo:400:kworker.0 Request processed in 50us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529164.362754:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529164.362770:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782529164.362777:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117213696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.362809:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117213696:12345-0@lo:400:kworker.0 Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529164.362815:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782529164.362860:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117213056 00000100:00100000:2.0:1782529164.362864:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117213056 00000100:00100000:2.0:1782529164.362890:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1782529164.362896:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117213056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.365243:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117213056:12345-0@lo:400:kworker.0 Request processed in 2341us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529164.365253:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1782529164.365300:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117213568 00000100:00100000:2.0:1782529164.365305:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117213568 00000100:00100000:2.0:1782529164.365341:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117213184 00000100:00100000:2.0:1782529164.365343:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117213184 00000100:00100000:2.0:1782529164.365351:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117213312 00000100:00100000:2.0:1782529164.365352:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117213312 00000100:00100000:2.0:1782529164.365368:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782529164.365372:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117213568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.365420:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117213568:12345-0@lo:400:kworker.0 Request processed in 48us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529164.365436:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782529164.365447:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782529164.365457:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117213184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.365485:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117213184:12345-0@lo:400:kworker.0 Request processed in 33us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529164.365486:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782529164.365490:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782529164.365494:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117213312:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782529164.365520:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782529164.365524:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782529164.365527:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529164.365528:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117213312:12345-0@lo:400:kworker.0 Request processed in 36us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529164.365539:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782529164.365571:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117213312:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.365584:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117213184:0@lo:400:kworker.0 00010000:00080000:2.0:1782529164.365598:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb57b80 x1869117117213696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529164.365608:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117213696:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.365646:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117213056:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.365657:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117213568:0@lo:400:kworker.0 00010000:00080000:2.0:1782529164.365669:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb56a00 x1869117117213440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529164.365678:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117213440:0@lo:400:kworker.0 00000100:00100000:2.0:1782529164.371036:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117213824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529164.371113:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529164.372090:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117213824 00000100:00100000:3.0:1782529164.372101:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117213824 00000100:00100000:3.0:1782529164.372161:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782529164.372171:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117213824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529164.372212:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529164.372293:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117213824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529164.372300:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1782529164.372389:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cd9f80 x1869117117213824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529164.372411:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117213824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529164.627829:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529164.627934:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529164.628333:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108790528 00000100:00100000:3.0:1782529164.628344:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108790528 00000100:00100000:3.0:1782529164.628415:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:3.0:1782529164.628436:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108790528:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529164.628509:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108790528:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 76us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529164.628517:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00080000:2.0:1782529164.628572:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529164.629253:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108790400 00000100:00100000:0.0:1782529164.629259:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108790400 00000100:00100000:0.0:1782529164.629338:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 208 00000100:00100000:0.0:1782529164.629347:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2343:x1869117108790400:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529164.629410:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2343:x1869117108790400:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 65us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529164.629418:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 208 00010000:00010000:1.0:1782529164.742997:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529165.767132:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529166.795409:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529166.919410:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529166.919439:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117213952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529166.919516:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529166.919616:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117213952 00000100:00100000:1.0:1782529166.919624:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117213952 00000100:00100000:1.0:1782529166.919695:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782529166.919706:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117213952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782529166.919742:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529166.919791:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117213952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529166.919798:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1782529166.919869:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae4700 x1869117117213952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529166.919887:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117213952:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782529166.920080:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1782529167.404349:0:9986:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:59:26 (1782529166) === 00010000:00010000:1.0:1782529167.815079:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529167.905727:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529167.915135:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108790656 00000100:00100000:0.0:1782529167.915151:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108790656 00000100:00100000:0.0:1782529167.915217:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 209 00000100:00100000:0.0:1782529167.915227:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:8115:x1869117108790656:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782529167.915244:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529167.915263:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030600/0x72bfdc08f7eabbd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adcfd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529167.915292:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030600/0x72bfdc08f7eabbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcfd expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529167.915303:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030600/0x72bfdc08f7eabbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcfd expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529167.915312:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030600, rc 0) 00000100:00100000:0.0:1782529167.915391:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8115:x1869117108790656:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 165us (9674us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529167.915420:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 209 00000100:00100000:3.0:1782529167.925154:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529167.925322:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108790784 00000100:00100000:0.0:1782529167.925333:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108790784 00000100:00100000:0.0:1782529167.925402:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 210 00000100:00100000:0.0:1782529167.925413:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8115:x1869117108790784:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782529167.925728:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8115:x1869117108790784:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 315us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529167.925736:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 210 00000100:00100000:1.0:1782529167.939209:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529167.939329:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108790912 00000100:00100000:2.0:1782529167.939339:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108790912 00000100:00100000:2.0:1782529167.939402:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 211 00000100:00100000:2.0:1782529167.939413:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8115:x1869117108790912:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782529167.939791:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8115:x1869117108790912:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 378us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529167.939800:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 211 00000100:00100000:3.0:1782529167.949950:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529167.950201:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108791040 00000100:00100000:2.0:1782529167.950211:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108791040 00000100:00100000:2.0:1782529167.950269:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 212 00000100:00100000:2.0:1782529167.950279:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8119:x1869117108791040:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782529167.950577:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8119:x1869117108791040:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 299us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529167.950585:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 212 00000100:00100000:3.0:1782529168.014694:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529168.016598:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108791168 00000100:00100000:2.0:1782529168.016614:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108791168 00000100:00100000:2.0:1782529168.016699:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 213 00000100:00100000:2.0:1782529168.016711:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8119:x1869117108791168:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782529168.017064:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8119:x1869117108791168:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 354us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529168.017080:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 213 00000100:00100000:1.0:1782529168.027307:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529168.035551:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108791296 00000100:00100000:0.0:1782529168.035566:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108791296 00000100:00100000:0.0:1782529168.035703:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 214 00000100:00100000:0.0:1782529168.035715:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:8115:x1869117108791296:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782529168.035733:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529168.035750:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eabbda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add27 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529168.035779:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eabbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add27 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529168.035791:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eabbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add27 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529168.035799:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030a00, rc 0) 00000100:00100000:0.0:1782529168.035886:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:8115:x1869117108791296:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 173us (8589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529168.035893:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 214 00000100:00100000:3.0:1782529168.041038:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529168.042193:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108791424 00000100:00100000:2.0:1782529168.042207:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108791424 00000100:00100000:2.0:1782529168.042264:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 215 00000100:00100000:2.0:1782529168.042275:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:8115:x1869117108791424:12345-192.168.202.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782529168.042389:0:5787:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782529168.042425:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782529168.042430:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782529168.042432:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782529168.042434:0:5787:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782529168.045435:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:8115:x1869117108791424:12345-192.168.202.50@tcp:256:mount.lustre.0 Request processed in 3151us (4404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529168.045449:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 215 00000100:00100000:3.0:1782529168.050551:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529168.051629:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108791552 00000100:00100000:0.0:1782529168.051646:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108791552 00000100:00100000:0.0:1782529168.051720:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 216 00000100:00100000:0.0:1782529168.051733:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:8115:x1869117108791552:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782529168.051756:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529168.051782:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add2e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529168.051819:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529168.051862:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529168.051874:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030200, rc 0) 00000100:00100000:0.0:1782529168.051966:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8115:x1869117108791552:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 236us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529168.051974:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 216 00000100:00100000:3.0:1782529168.055913:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529168.056164:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108791680 00000100:00100000:2.0:1782529168.056176:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108791680 00000100:00100000:2.0:1782529168.056255:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 217 00000100:00100000:2.0:1782529168.056267:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8115:x1869117108791680:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782529168.056668:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8115:x1869117108791680:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 402us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529168.056677:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 217 00000100:00100000:3.0:1782529168.062158:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529168.062413:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108791808 00000100:00100000:1.0:1782529168.062427:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108791808 00000100:00100000:1.0:1782529168.062506:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 218 00000100:00100000:1.0:1782529168.062518:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8115:x1869117108791808:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782529168.063359:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8115:x1869117108791808:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 837us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529168.063372:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 218 00000100:00100000:3.0:1782529168.067714:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529168.067891:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108791936 00000100:00100000:0.0:1782529168.067905:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108791936 00000100:00100000:1.0:1782529168.068365:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 219 00000100:00100000:1.0:1782529168.068406:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8123:x1869117108791936:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782529168.068746:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8123:x1869117108791936:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 350us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529168.068756:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 219 00000100:00100000:3.0:1782529168.073616:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529168.073779:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108792064 00000100:00100000:2.0:1782529168.073793:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108792064 00000100:00100000:2.0:1782529168.073882:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 220 00000100:00100000:2.0:1782529168.073894:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8123:x1869117108792064:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782529168.074644:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:8123:x1869117108792064:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 745us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529168.074664:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 220 00000100:00100000:3.0:1782529168.085879:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529168.085926:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529168.091408:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108792576 00000100:00100000:1.0:1782529168.091430:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108792576 00000100:00080000:0.0:1782529168.091751:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529168.091796:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108792192 00000100:00100000:1.0:1782529168.091802:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108792192 00000100:00100000:1.0:1782529168.091868:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:1.0:1782529168.091886:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108792576:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529168.092027:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108792576:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 148us (6213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529168.092289:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:1.0:1782529168.092323:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1782529168.092329:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1869117108792192:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782529168.092433:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0893e068-92fc-4766-84ad-86afc0006669@192.168.202.50@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1782529168.092495:0:5794:0:(genops.c:1406:class_connect()) connect: client 0893e068-92fc-4766-84ad-86afc0006669, cookie 0x72bfdc08f7eabbe8 00000004:00100000:1.0:1782529168.092536:0:5794:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782529168.096527:0:5794:0:(import.c:65:import_set_state_nolock()) ffff99c680356000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529168.097575:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+6:2340:x1869117108792192:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 5235us (11639us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529168.097590:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1782529168.111404:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529168.111457:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529168.111561:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108792448 00000100:00100000:0.0:1782529168.111574:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108792448 00000100:00100000:0.0:1782529168.111678:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108792320 00000100:00100000:0.0:1782529168.111681:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108792320 00000100:00100000:0.0:1782529168.111714:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1782529168.111725:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+7:8115:x1869117108792448:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782529168.111790:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782529168.112009:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+7:8115:x1869117108792448:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 276us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529168.112046:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1782529168.112068:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:0.0:1782529168.112074:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+6:0:x1869117108792320:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782529168.112087:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782529168.112111:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+6:0:x1869117108792320:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 38us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529168.112117:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00080000:1.0:1782529168.113148:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529168.117986:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529168.119579:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108792704 00000100:00100000:0.0:1782529168.119615:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108792704 00000100:00100000:0.0:1782529168.119717:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:0.0:1782529168.119730:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+6:8115:x1869117108792704:12345-192.168.202.50@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782529168.119904:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+6:8115:x1869117108792704:12345-192.168.202.50@tcp:40:mount.lustre.0 Request processed in 177us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529168.119914:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:0.0:1782529168.123375:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529168.123429:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529168.123462:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529168.123603:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108792832 00000100:00100000:1.0:1782529168.123615:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108792832 00000100:00100000:1.0:1782529168.123685:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108792960 00000100:00100000:1.0:1782529168.123688:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108792960 00000100:00100000:1.0:1782529168.123706:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1782529168.123715:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1869117108792832:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782529168.123758:0:6593:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0893e068-92fc-4766-84ad-86afc0006669@192.168.202.50@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1782529168.123806:0:6593:0:(genops.c:1406:class_connect()) connect: client 0893e068-92fc-4766-84ad-86afc0006669, cookie 0x72bfdc08f7eabbef 00002000:00100000:1.0:1782529168.123822:0:6593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0893e068-92fc-4766-84ad-86afc0006669/ffff99c680357800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782529168.123887:0:6593:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782529168.124499:0:6593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782529168.124541:0:6593:0:(import.c:65:import_set_state_nolock()) ffff99c680354800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529168.124648:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0893e068-92fc-4766-84ad-86afc0006669+6:2340:x1869117108792832:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 933us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529168.124658:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1782529168.124688:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:1.0:1782529168.124693:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1869117108792960:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782529168.124718:0:6593:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0893e068-92fc-4766-84ad-86afc0006669@192.168.202.50@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1782529168.124741:0:6593:0:(genops.c:1406:class_connect()) connect: client 0893e068-92fc-4766-84ad-86afc0006669, cookie 0x72bfdc08f7eabbf6 00002000:00100000:1.0:1782529168.124749:0:6593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0893e068-92fc-4766-84ad-86afc0006669/ffff99c680352800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782529168.124770:0:6593:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1782529168.125439:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108793088 00000100:00100000:2.0:1782529168.125450:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108793088 00000100:00100000:2.0:1782529168.125519:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:2.0:1782529168.125528:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0893e068-92fc-4766-84ad-86afc0006669+6:8115:x1869117108793088:12345-192.168.202.50@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782529168.125883:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1782529168.126552:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0893e068-92fc-4766-84ad-86afc0006669+6:8115:x1869117108793088:12345-192.168.202.50@tcp:33:mount.lustre.0 Request processed in 1020us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529168.126564:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00002000:00080000:1.0:1782529168.126956:0:6593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782529168.126999:0:6593:0:(import.c:65:import_set_state_nolock()) ffff99c680352000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529168.127602:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0893e068-92fc-4766-84ad-86afc0006669+6:2340:x1869117108792960:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 2905us (4136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529168.127614:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00010000:00010000:1.0:1782529168.840393:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529169.487311:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117214080:0@lo:400:kworker.0 00000100:00100000:0.0:1782529169.487421:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529169.487571:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117214336:0@lo:400:kworker.0 00000100:00100000:1.0:1782529169.487610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529169.487748:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117214464:0@lo:400:kworker.0 00000100:00100000:2.0:1782529169.487789:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529169.487820:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117214208:0@lo:400:kworker.0 00000100:00100000:2.0:1782529169.487870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529169.487901:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117214336 00000100:00100000:2.0:1782529169.487909:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117214336 00000100:00100000:2.0:1782529169.487975:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117214208 00000100:00100000:2.0:1782529169.487979:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117214208 00000100:00100000:3.0:1782529169.488299:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117214080 00000100:00100000:3.0:1782529169.488305:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117214080 00000100:00100000:3.0:1782529169.488341:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782529169.488352:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117214080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529169.488431:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117214080:12345-0@lo:400:kworker.0 Request processed in 81us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529169.488439:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1782529169.489136:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782529169.489152:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117214336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529169.489208:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117214336:12345-0@lo:400:kworker.0 Request processed in 61us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529169.489214:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782529169.489236:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782529169.489241:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117214208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529169.489287:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117214208:12345-0@lo:400:kworker.0 Request processed in 46us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529169.489294:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1782529169.489314:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529169.489803:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117214080:0@lo:400:kworker.0 00000100:00100000:0.0:1782529169.489816:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117214592:0@lo:400:kworker.0 00000100:00100000:0.0:1782529169.489886:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529169.489924:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117214464 00000100:00100000:0.0:1782529169.489924:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117214592 00000100:00100000:1.0:1782529169.489933:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117214464 00000100:00100000:0.0:1782529169.489936:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117214592 00000100:00100000:1.0:1782529169.489982:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782529169.491165:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117214464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529169.491722:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117214464:12345-0@lo:400:kworker.0 Request processed in 1730us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529169.491733:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782529169.492796:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782529169.492814:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117214592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529169.492920:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117214592:12345-0@lo:400:kworker.0 Request processed in 110us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529169.492928:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782529169.494130:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117214336:0@lo:400:kworker.0 00000100:00100000:0.0:1782529169.494169:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117214848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529169.494229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529169.494462:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117214848 00000100:00100000:3.0:1782529169.494535:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117214848 00000100:00100000:3.0:1782529169.494594:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782529169.494603:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117214848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529169.494630:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529169.494682:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117214848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529169.494689:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1782529169.495391:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb57480 x1869117117214848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529169.495422:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117214848:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782529169.496423:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782529169.496433:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782529169.496499:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680a40e00 x1869117117214464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529169.496515:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117214464:0@lo:400:kworker.0 00000100:00100000:3.0:1782529169.498093:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117214208:0@lo:400:kworker.0 00000100:00100000:3.0:1782529169.498113:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117214720:0@lo:400:kworker.0 00000100:00100000:3.0:1782529169.498193:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529169.498417:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117214720 00000100:00100000:3.0:1782529169.498427:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117214720 00000100:00100000:3.0:1782529169.498569:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782529169.498580:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117214720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529169.498641:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117214720:12345-0@lo:400:kworker.0 Request processed in 64us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529169.498649:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1782529169.498686:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680a41880 x1869117117214720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529169.498698:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117214720:0@lo:400:kworker.0 00000100:00100000:2.0:1782529169.498814:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117214592:0@lo:400:kworker.0 00000100:00080000:2.0:1782529169.498867:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782529169.869924:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529170.888000:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782529171.071538:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0893e068-92fc-4766-84ad-86afc0006669 00000001:00100000:3.0:1782529171.108082:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0893e068-92fc-4766-84ad-86afc0006669 00010000:00010000:0.0:1782529171.911244:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529172.042743:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529172.042768:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117214976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529172.042867:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529172.043024:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117214976 00000100:00100000:3.0:1782529172.043032:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117214976 00000100:00100000:3.0:1782529172.043109:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782529172.043119:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117214976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529172.043155:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529172.043201:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117214976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529172.043207:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1782529172.043354:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782529172.043397:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae5f80 x1869117117214976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529172.043416:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117214976:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1782529172.594718:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0893e068-92fc-4766-84ad-86afc0006669 00010000:00010000:1.0:1782529172.935674:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529173.327892:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529173.328663:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108793216 00000100:00100000:2.0:1782529173.328681:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108793216 00000100:00100000:2.0:1782529173.328775:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 222 00000100:00100000:2.0:1782529173.328788:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108793216:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529173.328923:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108793216:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 137us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529173.328933:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 222 00000100:00100000:2.0:1782529173.336149:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529173.336199:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529173.336230:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529173.336267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529173.336315:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108793344 00000100:00100000:0.0:1782529173.336331:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108793344 00000100:00100000:0.0:1782529173.336408:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108793472 00000100:00100000:0.0:1782529173.336412:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108793472 00000100:00100000:0.0:1782529173.336459:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:0.0:1782529173.336469:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108793344:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529173.336553:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108793344:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 85us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529173.336561:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:0.0:1782529173.336579:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:0.0:1782529173.336586:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108793472:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529173.336609:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108793472:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529173.336616:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00080000:0.0:1782529173.336633:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529173.337043:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108793600 00000100:00100000:1.0:1782529173.337048:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108793600 00000100:00100000:1.0:1782529173.337120:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108793728 00000100:00100000:1.0:1782529173.337123:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108793728 00000100:00100000:2.0:1782529173.338150:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:2.0:1782529173.338176:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108793600:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529173.338301:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108793600:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 138us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529173.338309:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00080000:0.0:1782529173.340659:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782529173.340670:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529173.340859:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:1.0:1782529173.340876:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108793728:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529173.340962:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108793728:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 94us (4693us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529173.340970:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00010000:00010000:0.0:1782529173.960047:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782529174.088141:0:10182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1782529174.602415:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117215232:0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.602491:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529174.602578:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117215232 00000100:00100000:1.0:1782529174.602586:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117215232 00000100:00100000:1.0:1782529174.602644:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782529174.602661:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117215232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.602716:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117215232:12345-0@lo:400:kworker.0 Request processed in 55us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529174.602723:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782529174.602766:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117215232:0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.602799:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529174.602804:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117215360:0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.602827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529174.602883:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117215360 00000100:00100000:1.0:1782529174.602886:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117215360 00000100:00100000:1.0:1782529174.602919:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782529174.602925:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117215360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.602973:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117215360:12345-0@lo:400:kworker.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529174.602979:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1782529174.602994:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529174.603016:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117215360:0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.603057:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117215744:0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.603086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529174.603114:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117215744 00000100:00100000:1.0:1782529174.603118:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117215744 00000100:00100000:1.0:1782529174.603552:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782529174.603559:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117215744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.603600:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117215744:12345-0@lo:400:kworker.0 Request processed in 41us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529174.603606:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1782529174.603630:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782529174.603650:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c678688a80 x1869117117215744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529174.603663:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117215744:0@lo:400:kworker.0 00000100:00100000:0.0:1782529174.603874:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117215104:0@lo:400:kworker.0 00000100:00100000:0.0:1782529174.603910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529174.603934:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67868a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117215616:0@lo:400:kworker.0 00000100:00100000:0.0:1782529174.603972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529174.603992:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529174.603998:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117215488:0@lo:400:kworker.0 00000100:00100000:0.0:1782529174.604019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529174.604043:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117215616 00000100:00100000:0.0:1782529174.604047:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117215616 00000100:00100000:0.0:1782529174.604079:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782529174.604086:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117215616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529174.604121:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117215616:12345-0@lo:400:kworker.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529174.604146:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1782529174.604166:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529174.604186:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67868a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117215616:0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.604518:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117215104 00000100:00100000:1.0:1782529174.604523:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117215104 00000100:00100000:1.0:1782529174.604570:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1782529174.604577:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117215104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.604619:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117215104:12345-0@lo:400:kworker.0 Request processed in 43us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529174.604625:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1782529174.604654:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117215488 00000100:00100000:1.0:1782529174.604658:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117215488 00000100:00100000:1.0:1782529174.604687:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782529174.604693:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117215488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.604724:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117215488:12345-0@lo:400:kworker.0 Request processed in 31us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529174.604730:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1782529174.604744:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782529174.604764:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c678688000 x1869117117215488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529174.604774:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117215488:0@lo:400:kworker.0 00000100:00100000:1.0:1782529174.604784:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117215104:0@lo:400:kworker.0 00000100:00100000:3.0:1782529174.605147:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782529174.605159:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117215872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529174.605196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529174.605437:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117215872 00000100:00100000:2.0:1782529174.605442:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117215872 00000100:00100000:2.0:1782529174.605483:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782529174.605492:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117215872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529174.605520:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529174.605575:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117215872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529174.605582:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1782529174.605992:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb57100 x1869117117215872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529174.606011:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117215872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782529174.983585:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529176.007316:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529176.335659:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529176.335708:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529176.335736:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529176.335773:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529176.335797:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529176.335951:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108794368 00000100:00100000:3.0:1782529176.335964:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108794368 00000100:00100000:3.0:1782529176.336048:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108794240 00000100:00100000:3.0:1782529176.336051:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108794240 00000100:00100000:3.0:1782529176.336080:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:3.0:1782529176.336091:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794368:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529176.336373:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794368:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 282us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529176.336383:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:3.0:1782529176.336402:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:3.0:1782529176.336428:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794240:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529176.336459:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794240:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 32us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529176.336465:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00080000:0.0:1782529176.336966:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782529176.336972:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529176.337223:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108794112 00000100:00100000:1.0:1782529176.337231:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108794112 00000100:00100000:1.0:1782529176.337305:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108793984 00000100:00100000:1.0:1782529176.337331:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108793984 00000100:00100000:1.0:1782529176.337366:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:1.0:1782529176.337373:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794112:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529176.337429:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794112:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 56us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529176.337437:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:1.0:1782529176.337451:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:1.0:1782529176.337457:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108793984:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529176.337485:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108793984:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529176.337491:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:2.0:1782529176.337695:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108793856 00000100:00100000:2.0:1782529176.337701:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108793856 00000100:00100000:2.0:1782529176.337738:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 224 00000100:00100000:2.0:1782529176.337745:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108793856:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529176.337782:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108793856:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 38us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529176.337789:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 224 00000100:00080000:0.0:1782529176.337858:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782529177.032201:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529177.159793:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117216000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782529177.159931:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529177.160431:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117216000 00000100:00100000:2.0:1782529177.160442:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117216000 00000100:00100000:2.0:1782529177.160527:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782529177.160538:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117216000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529177.160586:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529177.160645:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117216000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529177.160653:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1782529177.160922:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782529177.161478:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c678688000 x1869117117216000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529177.161505:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117216000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782529178.054988:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529179.079158:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529179.720222:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117216128:0@lo:400:kworker.0 00000100:00100000:2.0:1782529179.720326:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529179.720341:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117216384:0@lo:400:kworker.0 00000100:00100000:2.0:1782529179.720385:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117216640:0@lo:400:kworker.0 00000100:00100000:1.0:1782529179.720387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529179.720426:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782529179.720434:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117216256:0@lo:400:kworker.0 00000100:00100000:2.0:1782529179.720446:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529179.720467:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529179.720475:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782529179.720483:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117216512:0@lo:400:kworker.0 00000100:00100000:1.0:1782529179.720492:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117216768:0@lo:400:kworker.0 00000100:00100000:2.0:1782529179.720522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529179.720570:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117216512 00000100:00100000:2.0:1782529179.720577:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117216512 00000100:00100000:1.0:1782529179.720585:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117216384 00000100:00100000:1.0:1782529179.720591:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117216384 00000100:00100000:2.0:1782529179.720632:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782529179.720642:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117216512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529179.720691:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117216512:12345-0@lo:400:kworker.0 Request processed in 50us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529179.720698:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1782529179.720738:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb57480 x1869117117216512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529179.720751:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117216512:0@lo:400:kworker.0 00000100:00100000:1.0:1782529179.721084:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117216640 00000100:00100000:1.0:1782529179.721089:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117216640 00000100:00100000:1.0:1782529179.721112:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117216256 00000100:00100000:1.0:1782529179.721115:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117216256 00000100:00100000:2.0:1782529179.721119:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782529179.721130:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117216384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529179.721135:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782529179.721154:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117216640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529179.721168:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117216384:12345-0@lo:400:kworker.0 Request processed in 41us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529179.721175:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782529179.721191:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782529179.721197:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117216256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529179.721205:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117216640:12345-0@lo:400:kworker.0 Request processed in 52us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529179.721213:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782529179.721232:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117216256:12345-0@lo:400:kworker.0 Request processed in 35us (765us total) trans 0 rc 0/0 00000100:00080000:1.0:1782529179.721244:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529179.721247:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1782529179.721250:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529179.721265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529179.721292:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117216768 00000100:00100000:2.0:1782529179.721306:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117216768 00000100:00100000:1.0:1782529179.721314:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117216384:0@lo:400:kworker.0 00000100:00100000:1.0:1782529179.721340:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117216256:0@lo:400:kworker.0 00000100:00100000:2.0:1782529179.721346:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782529179.721358:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117216768:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782529179.721371:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529179.721394:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117216640:0@lo:400:kworker.0 00000100:00100000:2.0:1782529179.721405:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117216768:12345-0@lo:400:kworker.0 Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529179.721414:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1782529179.721427:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f757100 x1869117117216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529179.721439:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117216768:0@lo:400:kworker.0 00000100:00100000:1.0:1782529179.722087:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117216128 00000100:00100000:1.0:1782529179.722093:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117216128 00000100:00100000:1.0:1782529179.722189:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1782529179.722198:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117216128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529179.722248:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117216128:12345-0@lo:400:kworker.0 Request processed in 52us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529179.722256:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1782529179.722357:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117216128:0@lo:400:kworker.0 00000100:00100000:0.0:1782529179.724171:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782529179.724199:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117216896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529179.724284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529179.724751:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117216896 00000100:00100000:1.0:1782529179.724765:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117216896 00000100:00100000:1.0:1782529179.724850:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782529179.724883:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117216896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782529179.724935:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529179.725004:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117216896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529179.725012:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1782529179.726093:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680a42680 x1869117117216896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529179.726132:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117216896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782529180.103010:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529181.128717:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529181.518411:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529181.518466:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529181.518498:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529181.518502:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108794624 00000100:00100000:0.0:1782529181.518512:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108794624 00000100:00100000:3.0:1782529181.518535:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529181.518569:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529181.518573:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108794752 00000100:00100000:0.0:1782529181.518577:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108794752 00000100:00100000:3.0:1782529181.518602:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:0.0:1782529181.518610:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:3.0:1782529181.518617:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108794624:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529181.518624:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794752:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529181.518693:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108794624:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529181.518703:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794752:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529181.518704:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:0.0:1782529181.518723:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00080000:0.0:1782529181.518748:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529181.518875:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108794496 00000100:00100000:3.0:1782529181.518880:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108794496 00000100:00100000:3.0:1782529181.518914:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 226 00000100:00100000:2.0:1782529181.518926:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108794880 00000100:00100000:3.0:1782529181.518933:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108794496:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529181.518944:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108794880 00000100:00100000:2.0:1782529181.518985:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108795008 00000100:00100000:2.0:1782529181.518989:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108795008 00000100:00100000:3.0:1782529181.518992:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108794496:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 70us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529181.519001:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 226 00000100:00100000:2.0:1782529181.519020:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1782529181.519029:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794880:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529181.519073:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108794880:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 45us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529181.519081:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1782529181.519224:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:2.0:1782529181.519231:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108795008:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529181.519254:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108795008:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529181.519261:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00080000:2.0:1782529181.519300:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782529181.519303:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782529182.152615:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529182.279302:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117217024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529182.279414:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529182.280024:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117217024 00000100:00100000:0.0:1782529182.280035:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117217024 00000100:00100000:0.0:1782529182.280107:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782529182.280118:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117217024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782529182.280166:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782529182.280295:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529182.283597:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117217024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3467us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529182.283615:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1782529182.284419:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6457f5f80 x1869117117217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529182.284450:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117217024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782529183.175676:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529184.199340:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529184.839961:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117217536:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840040:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529184.840102:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782529184.840109:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117217152:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840141:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529184.840168:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117217664:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840193:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529184.840222:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117217408:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529184.840275:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782529184.840280:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117217280:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529184.840315:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117217792:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529184.840363:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117217152 00000100:00100000:2.0:1782529184.840371:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117217152 00000100:00100000:2.0:1782529184.840416:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1782529184.840424:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117217152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840473:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117217152:12345-0@lo:400:kworker.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529184.840480:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1782529184.840528:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117217664 00000100:00100000:2.0:1782529184.840532:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117217664 00000100:00100000:2.0:1782529184.840566:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117217408 00000100:00100000:2.0:1782529184.840569:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117217408 00000100:00100000:2.0:1782529184.840582:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117217280 00000100:00100000:2.0:1782529184.840584:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117217280 00000100:00100000:2.0:1782529184.840595:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782529184.840600:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117217664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840633:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117217664:12345-0@lo:400:kworker.0 Request processed in 33us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529184.840640:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782529184.840653:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782529184.840659:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117217408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840690:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117217408:12345-0@lo:400:kworker.0 Request processed in 31us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529184.840696:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782529184.840707:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782529184.840713:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117217280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840739:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117217280:12345-0@lo:400:kworker.0 Request processed in 27us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529184.840745:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782529184.840763:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117217536 00000100:00100000:2.0:1782529184.840766:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117217536 00000100:00100000:2.0:1782529184.840792:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117217792 00000100:00100000:2.0:1782529184.840795:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117217792 00000100:00100000:2.0:1782529184.840816:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782529184.840823:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117217536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840896:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117217536:12345-0@lo:400:kworker.0 Request processed in 74us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529184.840908:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782529184.840920:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782529184.840925:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117217792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.840955:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117217792:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529184.840960:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1782529184.840979:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782529184.840984:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782529184.840986:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529184.841043:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117217280:0@lo:400:kworker.0 00010000:00080000:2.0:1782529184.841057:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6457f6680 x1869117117217792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529184.841068:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117217792:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.841078:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117217408:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.841110:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117217152:0@lo:400:kworker.0 00000100:00100000:2.0:1782529184.841120:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117217664:0@lo:400:kworker.0 00010000:00080000:2.0:1782529184.841129:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6457f4e00 x1869117117217536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529184.841139:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117217536:0@lo:400:kworker.0 00000100:00100000:3.0:1782529184.842504:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117217920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529184.842568:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529184.842637:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117217920 00000100:00100000:0.0:1782529184.842646:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117217920 00000100:00100000:0.0:1782529184.842690:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782529184.842697:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117217920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782529184.842731:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529184.846456:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117217920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3749us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529184.846470:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1782529184.846637:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6773b2680 x1869117117217920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529184.846663:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117217920:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782529185.230203:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529186.246949:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529186.640020:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529186.640071:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529186.640092:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108795136 00000100:00100000:3.0:1782529186.640102:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108795136 00000100:00100000:2.0:1782529186.640102:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529186.640119:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529186.640160:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529186.640235:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108795392 00000100:00100000:0.0:1782529186.640248:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108795392 00000100:00100000:0.0:1782529186.640292:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108795264 00000100:00100000:0.0:1782529186.640296:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108795264 00000100:00100000:0.0:1782529186.640317:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:0.0:1782529186.640326:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108795392:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529186.640411:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108795392:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529186.640419:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:0.0:1782529186.640438:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:0.0:1782529186.640445:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108795264:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529186.640469:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108795264:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529186.640475:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00080000:0.0:1782529186.640492:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529186.641519:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108795648 00000100:00100000:3.0:1782529186.641564:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 228 00000100:00100000:3.0:1782529186.641578:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108795136:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529186.641738:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108795648 00000100:00100000:2.0:1782529186.641778:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108795520 00000100:00100000:2.0:1782529186.641782:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108795520 00000100:00100000:2.0:1782529186.641803:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:2.0:1782529186.641812:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108795648:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529186.641916:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108795136:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 340us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529186.641933:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 228 00000100:00100000:2.0:1782529186.641949:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108795648:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 140us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529186.641955:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:2.0:1782529186.641966:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1782529186.641973:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108795520:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529186.641997:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108795520:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529186.642003:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00080000:1.0:1782529186.642673:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782529186.642678:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782529187.271259:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529187.399892:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117218048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529187.400010:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529187.400069:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117218048 00000100:00100000:0.0:1782529187.400080:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117218048 00000100:00080000:2.0:1782529187.400146:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529187.400186:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782529187.400193:0:6594:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1782529187.400204:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117218048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529187.400211:0:6594:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1782529187.400288:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529187.400377:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117218048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529187.400385:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1782529187.400520:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6457f7100 x1869117117218048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529187.400549:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117218048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782529188.295116:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529189.324814:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529189.960020:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117218176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529189.960127:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529189.960220:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117218176 00000100:00100000:3.0:1782529189.960228:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117218176 00000100:00100000:3.0:1782529189.960283:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782529189.960292:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117218176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529189.960327:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529189.960369:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117218176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529189.960383:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1782529189.960403:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782529189.960434:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6457f4700 x1869117117218176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529189.960453:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117218176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529189.960887:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117218432:0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.960919:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529189.960940:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782529189.960946:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67868bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117218304:0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.960972:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529189.960994:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117218816:0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961014:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529189.961039:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117218432 00000100:00100000:1.0:1782529189.961043:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117218432 00000100:00100000:1.0:1782529189.961071:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782529189.961078:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117218432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961126:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117218432:12345-0@lo:400:kworker.0 Request processed in 48us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529189.961132:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782529189.961150:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117218304 00000100:00100000:1.0:1782529189.961153:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117218304 00000100:00100000:1.0:1782529189.961174:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782529189.961198:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117218304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961234:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117218304:12345-0@lo:400:kworker.0 Request processed in 37us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529189.961240:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782529189.961265:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117218816 00000100:00100000:1.0:1782529189.961269:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117218816 00000100:00100000:1.0:1782529189.961297:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782529189.961303:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117218816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961329:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117218816:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529189.961335:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782529189.961360:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117218560:0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961383:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529189.961400:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529189.961405:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117218688:0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961425:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529189.961447:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117218560 00000100:00100000:1.0:1782529189.961450:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117218560 00000100:00100000:1.0:1782529189.961470:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117218688 00000100:00100000:1.0:1782529189.961472:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117218688 00000100:00100000:1.0:1782529189.961487:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782529189.961493:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117218560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961523:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117218560:12345-0@lo:400:kworker.0 Request processed in 30us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529189.961529:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782529189.961539:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782529189.961545:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117218688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961576:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117218688:12345-0@lo:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529189.961582:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1782529189.961600:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782529189.961604:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529189.961623:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117218688:0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961632:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117218560:0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961654:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67868bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117218304:0@lo:400:kworker.0 00010000:00080000:1.0:1782529189.961665:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c678689880 x1869117117218816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529189.961674:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117218816:0@lo:400:kworker.0 00000100:00100000:1.0:1782529189.961682:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117218432:0@lo:400:kworker.0 00000001:02000400:0.0:1782529190.092164:0:10885:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782529190.343118:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529191.367546:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529191.758039:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529191.758083:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529191.758114:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529191.758145:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108795904 00000100:00100000:0.0:1782529191.758154:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108795904 00000100:00100000:0.0:1782529191.758216:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108796032 00000100:00100000:0.0:1782529191.758220:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108796032 00000100:00100000:0.0:1782529191.758250:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:0.0:1782529191.758259:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108795904:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529191.758332:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108795904:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529191.758340:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:0.0:1782529191.758359:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:0.0:1782529191.758366:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108796032:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529191.758390:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108796032:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529191.758396:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00080000:0.0:1782529191.758414:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529191.758569:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108795776 00000100:00100000:3.0:1782529191.758573:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108795776 00000100:00100000:3.0:1782529191.758607:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 230 00000100:00100000:3.0:1782529191.758623:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108795776:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529191.758654:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108795776:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529191.758660:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 230 00000100:00100000:0.0:1782529191.760339:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529191.760363:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529191.765382:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108796160 00000100:00100000:1.0:1782529191.765398:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108796160 00000100:00100000:1.0:1782529191.765461:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108796288 00000100:00100000:1.0:1782529191.765464:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108796288 00000100:00100000:1.0:1782529191.765492:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529191.765501:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2340:x1869117108796160:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:1.0:1782529191.765531:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabbef 00000100:00080000:1.0:1782529191.765539:0:6592:0:(import.c:65:import_set_state_nolock()) ffff99c680354800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782529191.765576:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782529191.766331:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+2:2340:x1869117108796160:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 826us (5994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529191.766340:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529191.766369:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:1.0:1782529191.766377:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2340:x1869117108796288:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:1.0:1782529191.766394:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabbf6 00000100:00080000:1.0:1782529191.766401:0:6592:0:(import.c:65:import_set_state_nolock()) ffff99c680352000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782529191.766432:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1782529191.767031:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529191.767275:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0893e068-92fc-4766-84ad-86afc0006669+2:2340:x1869117108796288:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 895us (6907us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529191.767284:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00010000:00010000:0.0:1782529191.767779:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782529191.767788:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782529191.767792:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782529192.391187:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529192.521256:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117218944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529192.521331:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529192.521456:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117218944 00000100:00100000:2.0:1782529192.521465:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117218944 00000100:00080000:0.0:1782529192.521516:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529192.521524:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782529192.521550:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117218944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529192.521646:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529192.521708:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117218944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529192.521715:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1782529192.523037:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6457f4700 x1869117117218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529192.523061:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117218944:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1782529193.152451:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0893e068-92fc-4766-84ad-86afc0006669 00000020:00000080:1.0:1782529193.152464:0:6618:0:(genops.c:906:class_export_put()) final put ffff99c680357800/0893e068-92fc-4766-84ad-86afc0006669 00000020:00000080:3.0:1782529193.153498:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680357800/0893e068-92fc-4766-84ad-86afc0006669 for lustre-OST0000 00000020:00000080:3.0:1782529193.153564:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c680354800 for lustre-OST0000 00000020:00000080:0.0:1782529193.414790:0:11035:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6a0a4ac0 20000000:00000080:0.0:1782529193.414808:0:11035:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99c6805f4000 uarg=0000000000000000 00010000:00010000:2.0:1782529193.414968:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1782529193.414993:0:11035:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782529193.415001:0:11035:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782529193.415005:0:11035:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1782529193.423442:0:11036:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1782529193.423520:0:11035:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782529193.430120:0:11035:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782529193.430268:0:11035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430290:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430301:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430309:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430315:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430323:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430330:0:11035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430376:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430412:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 12 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529193.430429:0:11035:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219072:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529193.430576:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430586:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 18 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529193.430607:0:11035:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219200:0@lo:104: 00000100:00100000:2.0:1782529193.430648:0:11035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782529193.430689:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430697:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 18 pid: 5787 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529193.430705:0:11035:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219328:0@lo:104: 00000100:00100000:2.0:1782529193.430727:0:11035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782529193.430807:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.430815:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 18 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529193.430823:0:11035:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219456:0@lo:104: 00000100:00100000:2.0:1782529193.430866:0:11035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782529193.431408:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529193.431418:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 12 pid: 5787 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529193.431427:0:11035:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cda300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219584:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529193.431465:0:11035:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6461b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1782529193.431513:0:7496:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117219200 00000100:00100000:1.0:1782529193.431521:0:7496:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117219200 00000100:00100000:1.0:1782529193.431573:0:7496:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117219328 00000100:00100000:1.0:1782529193.431576:0:7496:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117219328 00000100:00100000:1.0:1782529193.431586:0:7496:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117219456 00000100:00100000:1.0:1782529193.431588:0:7496:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117219456 00000100:00100000:1.0:1782529193.432014:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782529193.432024:0:7496:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+5:11035:x1869117117219200:12345-0@lo:104: 00010000:00010000:1.0:1782529193.432037:0:7496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.432361:0:7496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782529193.432378:0:7496:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+5:11035:x1869117117219200:12345-0@lo:104: Request processed in 356us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529193.432385:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782529193.432405:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782529193.432413:0:7496:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+4:11035:x1869117117219328:12345-0@lo:104: 00010000:00010000:1.0:1782529193.432421:0:7496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.432466:0:7496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782529193.432472:0:7496:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+4:11035:x1869117117219328:12345-0@lo:104: Request processed in 60us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529193.432483:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782529193.432509:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+4:11035:x1869117117219456:12345-0@lo:104: 00000100:00100000:2.0:1782529193.432527:0:11035:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219200:0@lo:104: 00010000:00010000:3.0:1782529193.432530:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529193.432544:0:11035:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219328:0@lo:104: 00010000:00010000:3.0:1782529193.432626:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782529193.432635:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+4:11035:x1869117117219456:12345-0@lo:104: Request processed in 139us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529193.432709:0:11035:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219456:0@lo:104: 00000100:00100000:1.0:1782529193.432748:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1782529193.432772:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782529193.432779:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.432787:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972bc00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:1.0:1782529193.432791:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.432801:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782529193.432808:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529193.432815:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782529193.432913:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.432931:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782529193.432951:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.432957:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972bc00/0x72bfdc08f7eabbc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.432970:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782529193.432973:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.432978:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576c00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:1.0:1782529193.433136:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433146:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782529193.433152:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529193.433157:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782529193.433267:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433273:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782529193.433280:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433285:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c64a576c00/0x72bfdc08f7eabbb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433302:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529193.433305:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433310:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:1.0:1782529193.433313:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433319:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782529193.433325:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529193.433329:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782529193.433435:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433440:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782529193.433457:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433465:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972b000/0x72bfdc08f7eabba9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabbb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433479:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529193.433481:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529193.433483:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529193.433490:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529193.433508:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117219712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529193.433557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529193.433609:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529193.433616:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67868bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117219840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529193.433639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529193.433667:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117219968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529193.433689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529193.433722:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117219712 00000100:00100000:1.0:1782529193.433727:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117219712 00010000:00010000:1.0:1782529193.433751:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 19 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529193.433774:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117219840 00000100:00100000:1.0:1782529193.433777:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117219840 00010000:00010000:1.0:1782529193.433787:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 20 pid: 5787 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529193.433796:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117219968 00000100:00100000:1.0:1782529193.433798:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117219968 00010000:00010000:1.0:1782529193.433806:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 21 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529193.433817:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782529193.433823:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650287050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+21:3294:x1869117117219712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782529193.433853:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529193.433859:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 21 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433867:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 21 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433886:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972be00/0x72bfdc08f7eabbcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eabbc5 expref: 21 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433897:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529193.433927:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650287050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+20:3294:x1869117117219712:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529193.433934:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782529193.433974:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782529193.433980:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117219840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782529193.433987:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529193.433991:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 19 pid: 5787 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.433999:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 19 pid: 5787 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.434009:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972ac00/0x72bfdc08f7eabbbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eabbb7 expref: 19 pid: 5787 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.434017:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529193.434038:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+18:3294:x1869117117219840:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529193.434044:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782529193.434055:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782529193.434060:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+17:3296:x1869117117219968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782529193.434068:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529193.434071:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 17 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.434086:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 17 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.434097:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabbb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eabba9 expref: 17 pid: 5789 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.434107:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529193.434132:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3296:x1869117117219968:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529193.434138:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782529193.434177:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117219968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529193.434213:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67868bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117219840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529193.434220:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117219712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782529193.441375:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782529193.442145:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529193.442276:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529193.442348:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108796416 00000100:00100000:1.0:1782529193.442357:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108796416 00010000:00010000:1.0:1782529193.442400:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 13 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529193.442437:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108796544 00000100:00100000:1.0:1782529193.442441:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108796544 00010000:00010000:1.0:1782529193.442451:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 14 pid: 5787 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529193.442473:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:1.0:1782529193.442482:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+14:2344:x1869117108796416:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529193.442498:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529193.442513:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 14 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442526:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 14 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442544:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529193.442599:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+14:2344:x1869117108796416:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 118us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529193.442606:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:1.0:1782529193.442624:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:1.0:1782529193.442630:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108796544:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529193.442638:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529193.442642:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 13 pid: 5787 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442650:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 13 pid: 5787 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442662:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442669:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442683:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442690:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442706:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442712:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442718:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529193.442721:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442728:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442736:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529193.442746:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529193.442766:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108796544:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 136us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529193.442773:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00010000:00010000:0.0:1782529193.443003:0:11035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030200/0x72bfdc08f7eabbe1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add2e expref: 12 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529193.443017:0:11035:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219072:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529193.443042:0:11035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a576200/0x72bfdc08f7eabba2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcf6 expref: 11 pid: 5787 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529193.443051:0:11035:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cda300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1869117117219584:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529193.443081:0:11035:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529193.443089:0:11035:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529193.443094:0:11035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529193.443100:0:11035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eabbfd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529194.439893:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529194.641893:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529194.648029:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108796672 00000100:00100000:1.0:1782529194.648046:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108796672 00000100:00100000:2.0:1782529194.648219:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 231 00000100:00100000:2.0:1782529194.648230:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:5561:x1869117108796672:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529194.648246:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529194.648264:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add58 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529194.648290:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529194.648301:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529194.648310:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00800, rc 0) 00000100:00100000:2.0:1782529194.648382:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108796672:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 153us (6495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529194.648399:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 231 00000100:00100000:0.0:1782529194.660103:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529194.660184:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108796800 00000100:00100000:1.0:1782529194.660193:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108796800 00000100:00100000:1.0:1782529194.660246:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 232 00000100:00100000:1.0:1782529194.660257:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108796800:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529194.662321:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108796800:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 2054us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529194.662345:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 232 00000100:00100000:1.0:1782529194.674078:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529194.674793:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108796928 00000100:00100000:2.0:1782529194.674803:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108796928 00000100:00100000:2.0:1782529194.674924:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 233 00000100:00100000:2.0:1782529194.674937:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108796928:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529194.675225:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108796928:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 290us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529194.675233:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 233 00000100:00100000:2.0:1782529194.687156:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529194.690630:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108797056 00000100:00100000:1.0:1782529194.690646:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108797056 00000100:00100000:1.0:1782529194.690712:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 234 00000100:00100000:1.0:1782529194.690723:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108797056:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529194.690740:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529194.690758:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add5f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529194.690785:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529194.690796:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529194.690805:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a576c00, rc 0) 00000100:00100000:1.0:1782529194.690900:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108797056:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 179us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529194.690908:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 234 00000100:00100000:1.0:1782529194.694362:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529194.694432:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108797184 00000100:00100000:3.0:1782529194.694443:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108797184 00000100:00100000:3.0:1782529194.694496:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 235 00000100:00100000:3.0:1782529194.694506:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108797184:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529194.694964:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108797184:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 457us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529194.694973:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 235 00000100:00100000:2.0:1782529194.703676:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529194.704783:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108797312 00000100:00100000:0.0:1782529194.704795:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108797312 00000100:00100000:0.0:1782529194.705794:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 236 00000100:00100000:0.0:1782529194.705808:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108797312:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529194.706061:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108797312:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 255us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529194.706070:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 236 00000100:00100000:3.0:1782529195.082341:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117220096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529195.082415:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529195.082490:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117220096 00000100:00100000:3.0:1782529195.082497:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117220096 00000100:00100000:3.0:1782529195.082550:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782529195.082558:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117220096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529195.082648:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529195.082693:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117220096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529195.082700:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1782529195.082719:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782529195.082748:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6457f6680 x1869117117220096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529195.082766:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117220096:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1782529195.084362:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782529195.084370:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c67f60f000 from 7 10000000:01000000:3.0:1782529195.084390:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782529195.084435:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529195.084447:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529195.084456:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529195.084481:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117220224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782529195.084548:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529195.084583:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645bb7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529195.084604:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117220224 00000100:00100000:3.0:1782529195.084609:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117220224 00000100:00100000:3.0:1782529195.084651:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1782529195.084659:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117220224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529195.084670:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529195.084682:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabc12 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529195.084704:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529195.084714:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529195.084723:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045400, rc 0) 00000100:00100000:3.0:1782529195.084758:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117220224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529195.084773:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1782529195.084821:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117220224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529195.084856:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529195.084865:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529195.084921:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117220352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529195.084949:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529195.084967:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645bb7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529195.084979:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117220352 00000100:00100000:3.0:1782529195.084982:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117220352 00000100:00100000:3.0:1782529195.085004:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1782529195.085010:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117220352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529195.085262:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117220352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529195.085268:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1782529195.085300:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117220352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529195.085326:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117220480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529195.085360:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529195.085372:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645bb7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529195.085383:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117220480 00000100:00100000:3.0:1782529195.085387:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117220480 00000100:00100000:3.0:1782529195.085406:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1782529195.085420:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117220480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529195.085550:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117220480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529195.085557:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1782529195.085592:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117220480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782529195.086518:0:11133:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:1.0:1782529195.086667:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117220608:0@lo:400:kworker.0 00000100:00100000:3.0:1782529195.086681:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117220864:0@lo:400:kworker.0 00000100:00100000:3.0:1782529195.086742:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529195.086743:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117220736:0@lo:400:kworker.0 00000100:00100000:1.0:1782529195.086769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529195.086770:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782529195.086775:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117220992:0@lo:400:kworker.0 00000100:00100000:3.0:1782529195.086800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529195.086812:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117220864 00000100:00100000:1.0:1782529195.086817:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117220864 00000100:00100000:3.0:1782529195.086822:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117220736 00000100:00100000:3.0:1782529195.086825:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117220736 00000100:00100000:3.0:1782529195.086899:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782529195.087280:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782529195.087287:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117220864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529195.087332:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117220864:12345-0@lo:400:kworker.0 Request processed in 46us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529195.087339:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782529195.087904:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117220992 00000100:00100000:1.0:1782529195.087911:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117220992 00000100:00100000:1.0:1782529195.087948:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782529195.087955:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117220992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529195.088029:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117220992:12345-0@lo:400:kworker.0 Request processed in 75us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529195.088037:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782529195.088067:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529195.088106:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117220608 00000100:00100000:1.0:1782529195.088110:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117220608 00000100:00100000:1.0:1782529195.088129:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782529195.088134:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117220608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529195.088164:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117220608:12345-0@lo:400:kworker.0 Request processed in 29us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529195.088180:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782529195.088215:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117220608:0@lo:400:kworker.0 00000020:01000000:1.0:1782529195.088237:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782529195.088258:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782529195.088268:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.088279:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529195.088294:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782529195.088297:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c6795ce000 from 7 10000000:01000000:1.0:1782529195.088300:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529195.088327:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.088335:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.088344:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529195.088361:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529195.088392:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529195.088414:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426840 going to sleep for 11 seconds 00000100:00100000:3.0:1782529195.094506:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117220736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529195.094628:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117220736:12345-0@lo:400:kworker.0 Request processed in 7720us (7856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529195.094639:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1782529195.094678:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782529195.094684:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782529195.094720:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6457f7100 x1869117117220992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529195.094736:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117220992:0@lo:400:kworker.0 00000100:00100000:3.0:1782529195.094750:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117220864:0@lo:400:kworker.0 00000100:00100000:3.0:1782529195.094785:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117221120 00000100:00100000:3.0:1782529195.094792:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117221120 00000100:00100000:3.0:1782529195.094874:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1782529195.094883:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117221120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529195.094894:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529195.094910:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabc20 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529195.094910:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117220736:0@lo:400:kworker.0 00010000:00010000:3.0:1782529195.094932:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529195.094943:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529195.094952:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:3.0:1782529195.094992:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117221120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (6599us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529195.094998:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1782529195.095024:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529195.095041:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.095052:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529195.095129:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529195.095162:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529195.095204:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426840 going to sleep for 11 seconds 00000100:00100000:3.0:1782529195.098311:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117221248 00000100:00100000:3.0:1782529195.098325:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117221248 00000100:00100000:3.0:1782529195.098383:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1782529195.098393:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117221248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529195.098697:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117221248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529195.098705:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782529195.098749:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529195.098820:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529195.098884:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529195.098915:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426840 going to sleep for 11 seconds 00000100:00100000:0.0:1782529195.098982:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117221376 00000100:00100000:0.0:1782529195.098988:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117221376 00000100:00100000:0.0:1782529195.099019:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782529195.099025:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117221376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529195.099183:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117221376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529195.099190:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1782529195.099204:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782529195.100054:0:11134:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782529195.100123:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782529195.100139:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782529195.100150:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.100161:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529195.100185:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782529195.100188:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c646a6f800 from 7 10000000:01000000:1.0:1782529195.100191:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529195.100217:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.100225:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.100234:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529195.100250:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529195.100289:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529195.100302:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782529195.102286:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117221504 00000100:00100000:0.0:1782529195.102300:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117221504 00000100:00100000:0.0:1782529195.102363:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782529195.102373:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117221504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529195.102390:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529195.102407:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabc2e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529195.102436:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529195.102444:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529195.102451:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031c00, rc 0) 00000100:00100000:0.0:1782529195.102510:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117221504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529195.102516:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1782529195.102543:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529195.102562:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.102571:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529195.102636:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529195.102667:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529195.102693:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782529195.103570:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117221632 00000100:00100000:3.0:1782529195.103578:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117221632 00000100:00100000:3.0:1782529195.103620:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1782529195.103628:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117221632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529195.103962:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117221632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529195.103976:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1782529195.104079:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678688e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529195.104122:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529195.104180:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529195.104208:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67fb64b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782529195.104223:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117221760 00000100:00100000:0.0:1782529195.104227:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117221760 00000100:00100000:0.0:1782529195.104256:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1782529195.104261:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117221760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529195.104389:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117221760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529195.104394:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1782529195.104423:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117221760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782529195.105533:0:11135:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782529195.105679:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782529195.105702:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782529195.105712:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529195.105722:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529195.469489:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529196.487453:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782529196.686632:0:11233:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:0.0:1782529196.718164:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0893e068-92fc-4766-84ad-86afc0006669 00000020:00000080:0.0:1782529196.718174:0:7509:0:(genops.c:906:class_export_put()) final put ffff99c680352800/0893e068-92fc-4766-84ad-86afc0006669 00000020:00000080:0.0:1782529196.718205:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680352800/0893e068-92fc-4766-84ad-86afc0006669 for lustre-OST0001 00000020:00000080:0.0:1782529196.718250:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c680352000 for lustre-OST0001 00000100:00100000:1.0:1782529196.880443:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529196.880480:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529196.880516:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529196.880555:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108797696 00000100:00100000:1.0:1782529196.880565:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108797696 00000100:00100000:1.0:1782529196.880623:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108797568 00000100:00100000:1.0:1782529196.880626:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108797568 00000100:00100000:1.0:1782529196.880651:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:1.0:1782529196.880661:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108797696:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529196.880738:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108797696:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529196.880746:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:1.0:1782529196.880761:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:1.0:1782529196.880768:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108797568:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529196.880804:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2342:x1869117108797568:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529196.880811:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00080000:1.0:1782529196.880827:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529196.881030:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108797440 00000100:00100000:3.0:1782529196.881035:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108797440 00000100:00100000:3.0:1782529196.881073:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 246 00000100:00100000:3.0:1782529196.881080:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108797440:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529196.881115:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108797440:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 35us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529196.881122:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 246 00010000:00010000:1.0:1782529197.511201:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529197.639235:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117221888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529197.639317:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529197.639596:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117221888 00000100:00100000:3.0:1782529197.639605:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117221888 00000100:00100000:3.0:1782529197.639675:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782529197.639687:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117221888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529197.639733:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782529197.639855:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529197.640063:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117221888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 378us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529197.640071:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1782529197.649921:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb61c00 x1869117117221888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529197.649949:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117221888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782529198.537274:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529199.563154:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782529199.920345:0:11334:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:59:58 (1782529198) === 00000100:00100000:1.0:1782529200.202645:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117222016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529200.202715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529200.202782:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117222528:0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.202805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529200.202853:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782529200.202860:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117222400:0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.202885:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529200.202943:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.202967:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.202984:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117222272:0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203007:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529200.203023:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117222784:0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203043:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529200.203059:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782529200.203065:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117222144:0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203089:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529200.203137:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117222656:0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529200.203194:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117222528 00000100:00100000:1.0:1782529200.203201:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117222528 00000100:00100000:1.0:1782529200.203248:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117222784 00000100:00100000:1.0:1782529200.203251:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117222784 00000100:00100000:1.0:1782529200.203271:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782529200.203279:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117222528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203331:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117222528:12345-0@lo:400:kworker.0 Request processed in 52us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.203337:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782529200.203351:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782529200.203357:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117222784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203388:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117222784:12345-0@lo:400:kworker.0 Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.203394:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782529200.203409:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117222400 00000100:00100000:1.0:1782529200.203413:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117222400 00000100:00100000:1.0:1782529200.203430:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108797824 00000100:00100000:1.0:1782529200.203433:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108797824 00000100:00100000:1.0:1782529200.203444:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117222272 00000100:00100000:1.0:1782529200.203446:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117222272 00000100:00100000:1.0:1782529200.203455:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117222656 00000100:00100000:1.0:1782529200.203457:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117222656 00000100:00100000:1.0:1782529200.203470:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782529200.203476:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117222400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203505:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117222400:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.203519:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782529200.203531:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782529200.203536:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117222272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203567:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117222272:12345-0@lo:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.203572:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782529200.203583:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782529200.203589:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117222656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203614:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117222656:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.203619:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782529200.203630:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529200.203636:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2341:x1869117108797824:12345-192.168.202.50@tcp:41:mkdir.0 00000004:00000024:1.0:1782529200.203665:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782529200.203749:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2341:x1869117108797824:12345-192.168.202.50@tcp:41:mkdir.0 Request processed in 112us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.203756:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529200.203783:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117222144 00000100:00100000:1.0:1782529200.203786:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117222144 00000100:00100000:1.0:1782529200.203808:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1782529200.203815:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117222144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529200.203870:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117222144:12345-0@lo:400:kworker.0 Request processed in 55us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.203876:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1782529200.203909:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782529200.203914:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782529200.203916:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529200.204223:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108797952 00000100:00100000:0.0:1782529200.204228:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108797952 00000100:00100000:0.0:1782529200.204255:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:0.0:1782529200.204262:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:9668:x1869117108797952:12345-192.168.202.50@tcp:700:mkdir.0 00000100:00100000:0.0:1782529200.204297:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:9668:x1869117108797952:12345-192.168.202.50@tcp:700:mkdir.0 Request processed in 36us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529200.204313:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:0.0:1782529200.204371:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117222400:0@lo:400:kworker.0 00010000:00080000:0.0:1782529200.204385:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c646b0a680 x1869117117222528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529200.204396:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117222528:0@lo:400:kworker.0 00000100:00100000:0.0:1782529200.204431:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117222144:0@lo:400:kworker.0 00000100:00100000:0.0:1782529200.204440:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117222656:0@lo:400:kworker.0 00000100:00100000:0.0:1782529200.204450:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117222272:0@lo:400:kworker.0 00010000:00080000:0.0:1782529200.204459:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdea00 x1869117117222784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529200.204467:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117222784:0@lo:400:kworker.0 00000100:00100000:2.0:1782529200.204553:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117222016 00000100:00100000:2.0:1782529200.204558:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117222016 00000100:00100000:2.0:1782529200.204595:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782529200.204603:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117222016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529200.204625:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529200.204669:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117222016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529200.204676:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1782529200.204703:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fb60700 x1869117117222016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529200.204731:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117222016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529200.208942:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.209173:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108798208 00000100:00100000:1.0:1782529200.209183:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108798208 00000100:00100000:1.0:1782529200.209250:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:1.0:1782529200.209260:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:9668:x1869117108798208:12345-192.168.202.50@tcp:36:mkdir.0 00010000:00010000:1.0:1782529200.209315:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529200.209397:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabb1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adce1 expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.209418:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:1.0:1782529200.209431:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782529200.209790:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.209808:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.209817:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.209988:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.209998:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.210005:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529200.211228:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782529200.211247:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.211256:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.211263:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.211269:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529200.211273:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.211280:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.211292:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c643b34c00) 00010000:00010000:1.0:1782529200.211295:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529200.211300:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.211305:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782529200.211322:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1488825 reply state 0000000056061456 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529200.211331:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782529200.211432:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:9668:x1869117108798208:12345-192.168.202.50@tcp:36:mkdir.0 Request processed in 2172us (2498us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782529200.211441:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00010000:00010000:3.0:1782529200.214181:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.214196:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.214204:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.214210:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529200.214228:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.214238:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.214258:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99c643b34900) 00010000:00010000:3.0:1782529200.214261:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529200.214266:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.214273:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc43 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529200.227768:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.227879:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108798336 00000100:00100000:1.0:1782529200.227903:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108798336 00000100:00100000:1.0:1782529200.227965:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:1.0:1782529200.227976:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:9669:x1869117108798336:12345-192.168.202.50@tcp:101:chmod.0 00010000:00010000:1.0:1782529200.227998:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529200.228020:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add66 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.228089:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.228102:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.228113:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529200.228187:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782529200.228191:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529200.228230:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.228256:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add66 expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.228275:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add66 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.228284:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c643b34c00) 00010000:00010000:1.0:1782529200.228288:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782529200.228291:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c64a576400, rc 0) 00000100:00100000:1.0:1782529200.228361:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:9669:x1869117108798336:12345-192.168.202.50@tcp:101:chmod.0 Request processed in 387us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.228369:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:1.0:1782529200.231823:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.233428:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108798592 00000100:00100000:2.0:1782529200.233442:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108798592 00000100:00100000:2.0:1782529200.233553:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1782529200.233563:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:9669:x1869117108798592:12345-192.168.202.50@tcp:36:chmod.0 00010000:00010000:2.0:1782529200.233620:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529200.233649:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add66 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.233680:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c643b34c00) 00010000:00010000:2.0:1782529200.233693:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529200.233719:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.233732:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.233753:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529200.234075:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad6f7dd8 reply state 000000008e4478e6 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529200.234086:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782529200.234099:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1782529200.234237:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:9669:x1869117108798592:12345-192.168.202.50@tcp:36:chmod.0 Request processed in 674us (2420us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782529200.234245:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00010000:00010000:0.0:1782529200.237376:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.237392:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.237399:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.237404:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529200.237409:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.237415:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.237441:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529200.237444:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782529200.237448:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.237454:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabc58 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529200.280705:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.280816:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108798720 00000100:00100000:2.0:1782529200.280826:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108798720 00000100:00100000:2.0:1782529200.280908:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:2.0:1782529200.280918:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:9670:x1869117108798720:12345-192.168.202.50@tcp:101:chown.0 00010000:00010000:2.0:1782529200.280939:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529200.280959:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabc5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add6d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.281014:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabc66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.281027:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabc66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.281038:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabc66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529200.281095:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782529200.281098:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529200.281143:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabc66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.281166:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabc5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add6d expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.281183:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabc66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add6d expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.281192:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568300) 00010000:00010000:2.0:1782529200.281194:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529200.281211:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00c00, rc 0) 00000100:00100000:2.0:1782529200.281275:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:9670:x1869117108798720:12345-192.168.202.50@tcp:101:chown.0 Request processed in 358us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529200.281282:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:3.0:1782529200.283117:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.283237:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108798848 00000100:00100000:1.0:1782529200.283246:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108798848 00000100:00100000:1.0:1782529200.283292:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:1.0:1782529200.283302:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:9670:x1869117108798848:12345-192.168.202.50@tcp:101:chown.0 00010000:00010000:1.0:1782529200.283318:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529200.283337:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add74 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283409:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283422:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283433:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283447:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283465:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283472:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283613:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eabc82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283623:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eabc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283631:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eabc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529200.283670:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782529200.283683:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529200.283708:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eabc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283720:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283726:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283743:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283750:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529200.283755:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283762:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283775:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568300) 00010000:00010000:1.0:1782529200.283784:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529200.283788:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283794:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a576400/0x72bfdc08f7eabc74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283808:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283813:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283819:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283823:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529200.283826:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283852:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283862:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99c643b34000) 00010000:00010000:1.0:1782529200.283864:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529200.283867:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283873:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577a00/0x72bfdc08f7eabc7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283906:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c64a577c00/0x72bfdc08f7eabc6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add74 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283931:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eabc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add74 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.283939:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c643b34a00) 00010000:00010000:1.0:1782529200.283941:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782529200.283943:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6800, rc 0) 00000100:00100000:1.0:1782529200.284009:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:9670:x1869117108798848:12345-192.168.202.50@tcp:101:chown.0 Request processed in 708us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529200.284016:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:3.0:1782529200.292595:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.293240:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108799104 00000100:00100000:2.0:1782529200.293252:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108799104 00000100:00100000:2.0:1782529200.293315:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:2.0:1782529200.293326:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:9670:x1869117108799104:12345-192.168.202.50@tcp:36:chown.0 00010000:00010000:2.0:1782529200.293390:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529200.293416:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eabc82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add74 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.293432:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c643b34a00) 00010000:00010000:2.0:1782529200.293441:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529200.293467:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.293478:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.293487:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782529200.387551:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1782529200.387571:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1782529200.390440:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c208f6f reply state 000000005f95e07e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529200.390458:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782529200.390645:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1782529200.390824:0:5794:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782529200.390864:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:9670:x1869117108799104:12345-192.168.202.50@tcp:36:chown.0 Request processed in 97536us (98276us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782529200.390874:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00010000:00010000:1.0:1782529200.391285:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.391295:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.391303:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.391309:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529200.391315:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.391323:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.391339:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c669568e00) 00010000:00010000:1.0:1782529200.391342:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782529200.391346:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.391362:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabc89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529200.412257:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.412363:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108799232 00000100:00100000:2.0:1782529200.412373:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108799232 00000100:00100000:2.0:1782529200.412436:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:2.0:1782529200.412446:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:9671:x1869117108799232:12345-192.168.202.50@tcp:101:touch.500 00010000:00010000:2.0:1782529200.412469:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529200.412489:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabc90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add7b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782529200.414805:0:5796:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2248us 00010000:00010000:0.0:1782529200.432016:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432040:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432052:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432067:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432074:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432080:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432535:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eabca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432544:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eabca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432559:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eabca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529200.432641:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782529200.432646:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529200.432881:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eabca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432895:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432902:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432910:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432917:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529200.432927:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432935:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432948:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568300) 00010000:00010000:0.0:1782529200.432951:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529200.432955:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432962:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eabc97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432985:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432992:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.432998:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.433003:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529200.433006:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.433012:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.433020:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99c642b0f900) 00010000:00010000:0.0:1782529200.433022:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529200.433025:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.433029:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eabc9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.433071:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabc90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add7b expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.433086:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eabca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add7b expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.433105:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c642b0f400) 00010000:00010000:0.0:1782529200.433108:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782529200.433110:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030200, rc 0) 00000100:00100000:0.0:1782529200.433202:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:9671:x1869117108799232:12345-192.168.202.50@tcp:101:touch.500 Request processed in 20756us (20954us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529200.433211:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:2.0:1782529200.441621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529200.441700:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108799488 00000100:00100000:0.0:1782529200.441710:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108799488 00000100:00100000:0.0:1782529200.441768:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:0.0:1782529200.441777:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:9671:x1869117108799488:12345-192.168.202.50@tcp:101:touch.500 00010000:00010000:0.0:1782529200.441797:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529200.441818:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eabcac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add82 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.442225:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.442242:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.442252:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.442529:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.442538:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.442556:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782529200.443651:0:6616:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1782529200.444217:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabcc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444234:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444244:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444374:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444382:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444389:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444395:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529200.444399:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444407:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444422:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c642b0f400) 00010000:00010000:0.0:1782529200.444425:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529200.444436:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444443:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782529200.444457:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d18d6b9a reply state 00000000ea54a922 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529200.444466:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782529200.444502:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eabcac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add82 expref: 10 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444517:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add82 expref: 9 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.444525:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99c642b0f100) 00010000:00010000:0.0:1782529200.444528:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529200.444530:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170a00, rc 0) 00000100:00100000:0.0:1782529200.444650:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:9671:x1869117108799488:12345-192.168.202.50@tcp:101:touch.500 Request processed in 2872us (3039us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782529200.444658:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1782529200.448725:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.448825:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108799744 00000100:00100000:1.0:1782529200.448862:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108799744 00000100:00100000:1.0:1782529200.448913:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:1.0:1782529200.448922:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:9671:x1869117108799744:12345-192.168.202.50@tcp:36:touch.500 00010000:00010000:1.0:1782529200.448979:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529200.449005:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabcc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add82 expref: 10 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.449024:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99c642b0f100) 00010000:00010000:1.0:1782529200.449037:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782529200.449082:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.449095:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.449105:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782529200.449242:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af8a3200 reply state 0000000028b5db57 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529200.449252:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782529200.449464:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:9671:x1869117108799744:12345-192.168.202.50@tcp:36:touch.500 Request processed in 542us (747us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1782529200.449485:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00010000:00010000:0.0:1782529200.449742:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.449752:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.449759:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.449775:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529200.449780:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.449789:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.449799:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff99c642b0f300) 00010000:00010000:0.0:1782529200.449802:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529200.449806:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.449812:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabcba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.453031:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.453047:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.453055:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.453060:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529200.453064:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.453071:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.453086:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99c643b34000) 00010000:00010000:1.0:1782529200.453089:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529200.453094:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.453100:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabccf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529200.473012:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529200.479927:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108799872 00000100:00100000:3.0:1782529200.479948:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108799872 00000100:00100000:3.0:1782529200.480048:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:3.0:1782529200.480060:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:9671:x1869117108799872:12345-192.168.202.50@tcp:101:touch.500 00010000:00010000:3.0:1782529200.480111:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529200.480153:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabcd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add89 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.480228:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add89 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.480244:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add89 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.480265:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:3.0:1782529200.480268:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782529200.480272:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045600, rc 0) 00000100:00100000:3.0:1782529200.480363:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:9671:x1869117108799872:12345-192.168.202.50@tcp:101:touch.500 Request processed in 305us (7360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529200.480371:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1782529200.484451:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.484560:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108800000 00000100:00100000:1.0:1782529200.484576:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108800000 00000100:00100000:1.0:1782529200.484653:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:1.0:1782529200.484670:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1869117108800000:12345-192.168.202.50@tcp:8:touch.500 00010000:00080000:1.0:1782529200.484704:0:6591:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1782529200.484758:0:6591:0:(genops.c:1406:class_connect()) connect: client 089f7aa7-7be0-48a9-8829-cfc80cd2ee18, cookie 0x72bfdc08f7eabcdd 00002000:00100000:1.0:1782529200.484772:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 089f7aa7-7be0-48a9-8829-cfc80cd2ee18/ffff99c67f35f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782529200.484783:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782529200.488653:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782529200.488714:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c67734a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782529200.488894:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2340:x1869117108800000:12345-192.168.202.50@tcp:8:touch.500 Request processed in 4172us (4409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529200.488910:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1782529200.496949:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.497481:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108800128 00000100:00100000:1.0:1782529200.497493:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108800128 00000100:00100000:1.0:1782529200.497580:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:1.0:1782529200.497591:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:0:x1869117108800128:12345-192.168.202.50@tcp:2:touch.500 00000100:00080000:2.0:1782529200.497827:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1782529200.549158:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000001:00080000:2.0:1782529200.549177:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1782529200.549444:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:0:x1869117108800128:12345-192.168.202.50@tcp:2:touch.500 Request processed in 51848us (52498us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782529200.549455:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1782529200.554501:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529200.554597:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108800384 00000100:00100000:0.0:1782529200.554607:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108800384 00000100:00100000:0.0:1782529200.554666:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:0.0:1782529200.554676:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:9671:x1869117108800384:12345-192.168.202.50@tcp:35:touch.500 00000100:00100000:0.0:1782529200.555215:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:9671:x1869117108800384:12345-192.168.202.50@tcp:35:touch.500 Request processed in 539us (722us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782529200.555224:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:0.0:1782529200.578779:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.579716:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108800512 00000100:00100000:2.0:1782529200.579739:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108800512 00000100:00100000:2.0:1782529200.579808:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:2.0:1782529200.579817:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:9672:x1869117108800512:12345-192.168.202.50@tcp:101:rm.0 00010000:00010000:2.0:1782529200.579877:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529200.579898:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01200/0x72bfdc08f7eabce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add90 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.579965:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.579979:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.579989:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529200.580049:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782529200.580053:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529200.580087:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.580138:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01200/0x72bfdc08f7eabce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add90 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.580155:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add90 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.580162:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c642b0f400) 00010000:00010000:2.0:1782529200.580165:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529200.580168:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00400, rc 0) 00000100:00100000:2.0:1782529200.580234:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:9672:x1869117108800512:12345-192.168.202.50@tcp:101:rm.0 Request processed in 417us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529200.580241:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00010000:00010000:0.0:1782529200.583053:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529200.594670:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529200.594776:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108800768 00000100:00100000:0.0:1782529200.594785:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108800768 00000100:00100000:0.0:1782529200.594879:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:0.0:1782529200.594889:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:9672:x1869117108800768:12345-192.168.202.50@tcp:101:rm.0 00010000:00010000:0.0:1782529200.594909:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529200.594929:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add97 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529200.595046:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1782529200.595215:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add97 expref: 14 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.595228:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568300) 00010000:00010000:0.0:1782529200.595230:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529200.595235:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabcf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add97 expref: 14 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.595248:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170000, rc 0) 00000100:00100000:0.0:1782529200.595306:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:9672:x1869117108800768:12345-192.168.202.50@tcp:101:rm.0 Request processed in 419us (654us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1782529200.595313:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:3.0:1782529200.599345:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.599491:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108800896 00000100:00100000:2.0:1782529200.599501:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108800896 00000100:00100000:2.0:1782529200.599559:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:2.0:1782529200.599569:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:9672:x1869117108800896:12345-192.168.202.50@tcp:37:rm.0 00000100:00100000:2.0:1782529200.606990:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:9672:x1869117108800896:12345-192.168.202.50@tcp:37:rm.0 Request processed in 7410us (7642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529200.607005:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1782529200.613336:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529200.613403:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108801152 00000100:00100000:0.0:1782529200.613414:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108801152 00000100:00100000:0.0:1782529200.613478:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:0.0:1782529200.613488:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:9672:x1869117108801152:12345-192.168.202.50@tcp:35:rm.0 00000100:00100000:0.0:1782529200.617235:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:9672:x1869117108801152:12345-192.168.202.50@tcp:35:rm.0 Request processed in 3735us (3894us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782529200.617270:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1782529200.621827:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529200.621991:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108801408 00000100:00100000:1.0:1782529200.622003:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108801408 00000100:00100000:1.0:1782529200.625944:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:1.0:1782529200.625977:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:9672:x1869117108801408:12345-192.168.202.50@tcp:101:rm.0 00010000:00010000:1.0:1782529200.626008:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529200.626033:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabd00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0add9e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.626173:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabd07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.626187:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabd07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.626197:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabd07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529200.626230:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1782529200.626393:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabd00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add9e expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.626413:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabd07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add9e expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.626422:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c642b0f400) 00010000:00010000:1.0:1782529200.626424:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782529200.626428:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7c00, rc 0) 00000100:00100000:1.0:1782529200.626566:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:9672:x1869117108801408:12345-192.168.202.50@tcp:101:rm.0 Request processed in 606us (4973us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1782529200.626574:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:1.0:1782529200.634459:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.634604:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108801536 00000100:00100000:2.0:1782529200.634617:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108801536 00000100:00100000:2.0:1782529200.634697:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:2.0:1782529200.634708:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:9672:x1869117108801536:12345-192.168.202.50@tcp:41:rm.0 00000004:00000024:2.0:1782529200.635022:0:6616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1782529200.635098:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:9672:x1869117108801536:12345-192.168.202.50@tcp:41:rm.0 Request processed in 391us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529200.635106:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:2.0:1782529200.639094:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529200.639184:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108801664 00000100:00100000:0.0:1782529200.639193:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108801664 00000100:00100000:0.0:1782529200.639247:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:0.0:1782529200.639256:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:9672:x1869117108801664:12345-192.168.202.50@tcp:101:rm.0 00010000:00010000:0.0:1782529200.639278:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529200.639298:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabd15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adda5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639363:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639390:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639401:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639415:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639423:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639430:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639551:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabd2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639581:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639588:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529200.639620:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782529200.639625:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529200.639644:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639655:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639663:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639670:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639677:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639682:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529200.639685:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639693:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639704:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c642b0f400) 00010000:00010000:0.0:1782529200.639707:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529200.639717:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.639723:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171000/0x72bfdc08f7eabd1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640116:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640134:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640139:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640145:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529200.640148:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640154:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640164:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff99c642b0f900) 00010000:00010000:0.0:1782529200.640167:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529200.640170:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640176:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabd23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640215:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabd15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adda5 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640244:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabd2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adda5 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.640251:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:0.0:1782529200.640254:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529200.640256:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:0.0:1782529200.640322:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:9672:x1869117108801664:12345-192.168.202.50@tcp:101:rm.0 Request processed in 1066us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529200.640329:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:3.0:1782529200.645079:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.646503:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108801920 00000100:00100000:2.0:1782529200.646516:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108801920 00000100:00100000:2.0:1782529200.646585:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:2.0:1782529200.646595:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:9672:x1869117108801920:12345-192.168.202.50@tcp:36:rm.0 00010000:00010000:2.0:1782529200.646666:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782529200.646694:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabd2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adda5 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.646716:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabcd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add89 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.646934:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:2.0:1782529200.646958:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add90 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.646966:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c642b0f400) 00010000:00010000:2.0:1782529200.646969:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529200.646990:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.647002:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.647028:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.647042:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.647048:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.647054:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.647209:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.647217:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.647222:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782529200.648317:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1782529200.648331:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 262560496884ns, next at 263560494402ns, rc = 0 00010000:00010000:2.0:1782529200.648827:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.648862:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.648872:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.648893:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.648899:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.648904:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.648985:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782529200.649007:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649013:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649018:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649023:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529200.649027:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649035:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649045:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99c669568c00) 00010000:00010000:2.0:1782529200.649048:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782529200.649052:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649068:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabd3f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649088:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649094:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649099:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649104:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529200.649107:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649113:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649131:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c642b0f400) 00010000:00010000:2.0:1782529200.649134:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529200.649137:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529200.649142:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabd31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529200.649151:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004fcd2d8f reply state 000000004f55af8c transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529200.649160:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529200.649272:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:9672:x1869117108801920:12345-192.168.202.50@tcp:36:rm.0 Request processed in 2675us (4200us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782529200.649281:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00010000:00010000:0.0:1782529200.657056:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.657074:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.657081:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.657087:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529200.657092:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.657099:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.657116:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff99c669568000) 00010000:00010000:0.0:1782529200.657128:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529200.657134:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529200.657157:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01e00/0x72bfdc08f7eabd38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529200.657952:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529200.658046:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108802176 00000100:00100000:2.0:1782529200.658056:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108802176 00000100:00100000:2.0:1782529200.658105:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:2.0:1782529200.658116:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:9672:x1869117108802176:12345-192.168.202.50@tcp:35:rm.0 00000100:00100000:2.0:1782529200.658385:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:9672:x1869117108802176:12345-192.168.202.50@tcp:35:rm.0 Request processed in 270us (438us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782529200.658393:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:2.0:1782529200.660933:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529200.661040:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108802432 00000100:00100000:3.0:1782529200.661048:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108802432 00000100:00100000:3.0:1782529200.661102:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:3.0:1782529200.661111:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:9672:x1869117108802432:12345-192.168.202.50@tcp:36:rm.0 00010000:00010000:3.0:1782529200.661177:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782529200.661203:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabd07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add9e expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.661243:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eabca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add7b expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.661254:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c642b0f400) 00010000:00010000:3.0:1782529200.661273:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabc66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add6d expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.661282:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568300) 00010000:00010000:3.0:1782529200.661287:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529200.661314:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.661325:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.661335:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.661345:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.661351:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.661357:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662065:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662087:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662094:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529200.662751:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1782529200.662771:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662778:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662785:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662790:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529200.662795:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662801:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662812:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99c6601f9400) 00010000:00010000:3.0:1782529200.662815:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782529200.662819:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662824:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045c00/0x72bfdc08f7eabd5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662866:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662879:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662885:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662890:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529200.662893:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662900:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662909:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9d00) 00010000:00010000:3.0:1782529200.662910:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529200.662913:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529200.662917:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7eabd4d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782529200.662928:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6fb1189 reply state 000000004a71a2ed transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529200.662938:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529200.663021:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:9672:x1869117108802432:12345-192.168.202.50@tcp:36:rm.0 Request processed in 1907us (2092us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1782529200.663030:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00010000:00010000:1.0:1782529200.663113:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529200.663128:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.663134:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529200.663137:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.663144:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.663153:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99c669568c00) 00010000:00010000:1.0:1782529200.663155:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782529200.663157:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.663170:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabd46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.663184:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529200.663186:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529200.663187:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529200.666711:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.666737:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.666744:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.666750:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529200.666756:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.666763:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.666779:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99c6601f9100) 00010000:00010000:1.0:1782529200.666782:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529200.666786:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529200.666792:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabd54 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529201.608468:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529202.001091:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529202.001135:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529202.001174:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529202.001210:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529202.001243:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108802560 00000100:00100000:2.0:1782529202.001253:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108802560 00000100:00100000:2.0:1782529202.001311:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 248 00000100:00100000:2.0:1782529202.001322:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2341:x1869117108802560:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529202.001397:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2341:x1869117108802560:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529202.001404:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 248 00000100:00100000:2.0:1782529202.001436:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108802816 00000100:00100000:2.0:1782529202.001439:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108802816 00000100:00100000:2.0:1782529202.001474:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:2.0:1782529202.001481:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2341:x1869117108802816:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529202.001528:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2341:x1869117108802816:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529202.001535:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00080000:2.0:1782529202.001633:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529202.001690:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108802688 00000100:00100000:0.0:1782529202.001694:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108802688 00000100:00100000:0.0:1782529202.001737:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108802944 00000100:00100000:0.0:1782529202.001741:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108802944 00000100:00100000:0.0:1782529202.001763:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:0.0:1782529202.001769:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:2341:x1869117108802688:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529202.001809:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:2341:x1869117108802688:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 39us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529202.001816:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:0.0:1782529202.001856:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:0.0:1782529202.001863:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2341:x1869117108802944:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529202.001888:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2341:x1869117108802944:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529202.001894:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00080000:2.0:1782529202.003319:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782529202.630988:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529202.761417:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782529202.761447:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117222912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529202.761540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529202.761648:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117222912 00000100:00100000:2.0:1782529202.761658:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117222912 00000100:00100000:2.0:1782529202.761747:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782529202.761762:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117222912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529202.761814:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529202.761891:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117222912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529202.761899:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1782529202.761926:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782529202.761968:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677053100 x1869117117222912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529202.761988:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117222912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782529203.659240:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529204.691179:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782529204.859389:0:11484:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1782529205.319154:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117223168:0@lo:400:kworker.0 00000100:00100000:2.0:1782529205.319260:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529205.319341:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117223680:0@lo:400:kworker.0 00000100:00100000:2.0:1782529205.319377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529205.319447:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529205.319454:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117223296:0@lo:400:kworker.0 00000100:00100000:2.0:1782529205.319485:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529205.319543:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117223168 00000100:00100000:2.0:1782529205.319553:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117223168 00000100:00100000:2.0:1782529205.319642:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117223296 00000100:00100000:2.0:1782529205.319646:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117223296 00000100:00100000:2.0:1782529205.319687:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782529205.319718:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117223168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529205.319793:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117223168:12345-0@lo:400:kworker.0 Request processed in 79us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.319803:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782529205.319826:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782529205.319864:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117223296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529205.319895:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117223296:12345-0@lo:400:kworker.0 Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.319901:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1782529205.319930:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529205.319969:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117223296:0@lo:400:kworker.0 00000100:00100000:2.0:1782529205.319982:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117223168:0@lo:400:kworker.0 00000100:00100000:1.0:1782529205.320388:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117223424:0@lo:400:kworker.0 00000100:00100000:1.0:1782529205.320428:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529205.320470:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782529205.320477:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117223040:0@lo:400:kworker.0 00000100:00100000:1.0:1782529205.320508:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529205.320529:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117223552:0@lo:400:kworker.0 00000100:00100000:1.0:1782529205.320552:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782529205.322016:0:6769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 267234178981ns, next at 268234174684ns, rc = 0 00000100:00100000:3.0:1782529205.322073:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117223680 00000100:00100000:3.0:1782529205.322112:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117223680 00000100:00100000:3.0:1782529205.322193:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117223424 00000100:00100000:3.0:1782529205.322197:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117223424 00000100:00100000:3.0:1782529205.322227:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782529205.322249:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117223680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529205.322357:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117223680:12345-0@lo:400:kworker.0 Request processed in 112us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529205.322365:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782529205.322382:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782529205.322389:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117223424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529205.322427:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117223424:12345-0@lo:400:kworker.0 Request processed in 38us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529205.322434:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782529205.322455:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117223552 00000100:00100000:3.0:1782529205.322458:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117223552 00000100:00100000:3.0:1782529205.322493:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782529205.322500:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117223552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529205.322533:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117223552:12345-0@lo:400:kworker.0 Request processed in 34us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529205.322539:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782529205.322560:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117223040 00000100:00100000:3.0:1782529205.322564:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117223040 00000100:00100000:3.0:1782529205.322589:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1782529205.322595:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117223040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529205.322822:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117223040:12345-0@lo:400:kworker.0 Request processed in 226us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529205.322828:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1782529205.322928:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782529205.322933:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782529205.322936:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529205.322969:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117223040:0@lo:400:kworker.0 00000100:00100000:3.0:1782529205.322985:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117223552:0@lo:400:kworker.0 00010000:00080000:3.0:1782529205.322998:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c68000a680 x1869117117223424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529205.323009:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117223424:0@lo:400:kworker.0 00010000:00080000:1.0:1782529205.323141:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680008700 x1869117117223680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529205.323152:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117223680:0@lo:400:kworker.0 00000100:00100000:1.0:1782529205.323167:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529205.323176:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117223808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529205.323220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529205.323368:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117223808 00000100:00100000:3.0:1782529205.323373:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117223808 00000100:00100000:3.0:1782529205.323416:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782529205.323424:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117223808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529205.323465:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529205.323512:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117223808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529205.323518:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1782529205.324459:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677a9ca80 x1869117117223808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529205.324488:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117223808:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1782529205.396986:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:0.0:1782529205.397126:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:0.0:1782529205.397210:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1782529205.397220:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1782529205.397340:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1782529205.397605:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782529205.397634:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117223936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782529205.397740:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529205.397944:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117223936 00000100:00100000:1.0:1782529205.397954:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117223936 00000100:00100000:1.0:1782529205.398008:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782529205.398019:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117223936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782529205.398056:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1782529205.398118:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a3f3cb0, atime: 0x6a3f3cb0, ctime: 0x6a3f3cb0, blocks: 0x1 00010000:00010000:1.0:1782529205.398144:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.398167:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=267s v=(0 0) 00010000:00010000:1.0:1782529205.398172:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529205.398180:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.398203:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.398216:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.398225:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.398249:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782529205.399232:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3295:x1869117117223936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1208us (1486us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782529205.399245:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1782529205.399294:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529205.399303:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.399315:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529205.399320:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.399338:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.399362:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.399370:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eabd62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529205.399395:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529205.399397:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529205.399399:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782529205.399816:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c67fae4000/2, rc 0, transno 4294967300 00000100:00100000:1.0:1782529205.399857:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117223936:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1782529205.400141:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00010000:00010000:2.0:1782529205.703098:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782529205.842767:0:11533:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6cc68750 20000000:00000080:2.0:1782529205.842792:0:11533:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99c67f5d6400 uarg=0000000000000000 20000000:01000000:2.0:1782529205.842875:0:11533:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782529205.842889:0:11533:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782529205.842895:0:11533:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1782529205.845578:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1782529205.846323:0:11533:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1782529205.853898:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1782529205.853959:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1782529205.854021:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1782529205.854038:0:11533:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782529205.854059:0:11533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854091:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854100:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854109:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854115:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854122:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854129:0:11533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854170:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854186:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 18 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.854209:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680009880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224064:0@lo:104: 00000100:00100000:2.0:1782529205.854273:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782529205.854337:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854345:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 18 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.854353:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224192:0@lo:104: 00000100:00100000:2.0:1782529205.854373:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529205.854408:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117224064 00000100:00100000:2.0:1782529205.854415:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117224064 00000100:00100000:2.0:1782529205.854457:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117224192 00000100:00100000:2.0:1782529205.854460:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117224192 00000100:00100000:2.0:1782529205.854475:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782529205.854482:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+4:11533:x1869117117224064:12345-0@lo:104: 00010000:00010000:2.0:1782529205.854497:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854549:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529205.854556:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+4:11533:x1869117117224064:12345-0@lo:104: Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.854562:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782529205.854580:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782529205.854586:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:11533:x1869117117224192:12345-0@lo:104: 00010000:00010000:2.0:1782529205.854592:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854644:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782529205.854649:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:11533:x1869117117224192:12345-0@lo:104: Request processed in 64us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.854657:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1782529205.854679:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782529205.854685:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854692:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576200 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529205.854696:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854705:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529205.854712:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529205.854717:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782529205.854742:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854749:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529205.854771:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854777:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c64a576200/0x72bfdc08f7eabc2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc35 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854801:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529205.854804:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854811:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577400 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529205.854814:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854820:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529205.854827:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529205.854860:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782529205.854875:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854882:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529205.854898:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854905:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c64a577400/0x72bfdc08f7eabc20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc27 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.854915:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529205.854917:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529205.854919:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529205.854925:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529205.854947:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117224320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529205.854975:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529205.855006:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c5410f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117224448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529205.855027:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529205.855055:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117224320 00000100:00100000:2.0:1782529205.855059:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117224320 00010000:00010000:2.0:1782529205.855091:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 19 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.855109:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117224448 00000100:00100000:2.0:1782529205.855112:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117224448 00010000:00010000:2.0:1782529205.855124:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 20 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.855140:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529205.855146:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+20:3295:x1869117117224320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782529205.855156:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529205.855161:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 20 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855171:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 20 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855185:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529205.855209:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+20:3295:x1869117117224320:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.855216:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529205.855227:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782529205.855233:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3296:x1869117117224448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782529205.855248:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529205.855252:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 19 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855261:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 19 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855269:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529205.855291:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3296:x1869117117224448:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.855297:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782529205.855338:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c5410f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117224448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529205.855359:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117224320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782529205.855385:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855395:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 18 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.855404:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb55880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224576:0@lo:104: 00000100:00100000:2.0:1782529205.855428:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529205.855452:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782529205.855460:0:5777:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117224576 00000100:00100000:2.0:1782529205.855463:0:5777:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117224576 00000100:00100000:2.0:1782529205.855483:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782529205.855489:0:5777:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646e87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:11533:x1869117117224576:12345-0@lo:104: 00010000:00010000:2.0:1782529205.855497:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855530:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529205.855536:0:5777:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646e87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+3:11533:x1869117117224576:12345-0@lo:104: Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.855542:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1782529205.855576:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529205.855580:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855586:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044600 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529205.855590:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855597:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529205.855602:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529205.855608:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782529205.855621:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855628:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529205.855639:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855645:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682044600/0x72bfdc08f7eabc12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eabc19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855668:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529205.855670:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529205.855671:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529205.855680:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117224704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529205.855705:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529205.855733:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117224704 00000100:00100000:2.0:1782529205.855736:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117224704 00010000:00010000:2.0:1782529205.855748:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 19 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.855765:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782529205.855772:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650286050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117224704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782529205.855779:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529205.855783:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 19 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855792:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 19 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.855801:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529205.855826:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650286050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117224704:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.855851:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782529205.855892:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117224704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782529205.855919:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.860719:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 12 pid: 5787 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.860744:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224832:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529205.860919:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.860928:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 12 pid: 5788 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.860948:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224960:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529205.860976:0:11533:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e540 going to sleep for 11 seconds 00010000:00010000:2.0:1782529205.861009:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640031c00/0x72bfdc08f7eabc35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eabc2e expref: 18 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.861022:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680009880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224064:0@lo:104: 00010000:00010000:2.0:1782529205.861032:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eabc27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eabc20 expref: 17 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.861041:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224192:0@lo:104: 00010000:00010000:2.0:1782529205.861050:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682045400/0x72bfdc08f7eabc19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eabc12 expref: 16 pid: 5788 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.861058:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb55880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224576:0@lo:104: 00000100:00100000:2.0:1782529205.871479:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224832:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529205.871497:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1869117117224960:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529205.871559:0:11533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529205.871666:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529205.871779:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529205.872266:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108803072 00000100:00100000:2.0:1782529205.872277:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108803072 00010000:00010000:2.0:1782529205.872339:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 13 pid: 5787 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.872378:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108803200 00000100:00100000:2.0:1782529205.872382:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108803200 00010000:00010000:2.0:1782529205.872395:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 14 pid: 5788 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529205.872429:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1782529205.872441:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+14:2343:x1869117108803072:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529205.872465:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529205.872472:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 14 pid: 5787 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872486:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 14 pid: 5787 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872510:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a576c00/0x72bfdc08f7eabc0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add5f expref: 14 pid: 5787 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872532:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529205.872612:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108803072:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 173us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.872622:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1782529205.872659:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:2.0:1782529205.872666:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:2343:x1869117108803200:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529205.872676:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529205.872681:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 12 pid: 5788 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872704:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 12 pid: 5788 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872716:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d00800/0x72bfdc08f7eabc04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add58 expref: 12 pid: 5788 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872728:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872739:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872758:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872766:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872774:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872781:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872788:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529205.872800:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872811:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872826:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.872868:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529205.872891:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:2343:x1869117108803200:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 225us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529205.872898:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00010000:00010000:2.0:1782529205.873048:0:11533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.873057:0:11533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529205.873064:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d01c00/0x72bfdc08f7eabd69 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782529205.962582:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1782529206.731691:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529207.125389:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529207.125441:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529207.125477:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529207.125518:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529207.125561:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108803456 00000100:00100000:2.0:1782529207.125575:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108803456 00000100:00100000:2.0:1782529207.125655:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108803712 00000100:00100000:2.0:1782529207.125658:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108803712 00000100:00100000:2.0:1782529207.125709:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 105 00000100:00100000:2.0:1782529207.125721:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108803456:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529207.125828:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108803456:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.125889:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 105 00000100:00100000:2.0:1782529207.125910:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00100000:2.0:1782529207.125919:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108803712:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529207.125945:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108803712:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.125953:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00080000:2.0:1782529207.125973:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529207.126509:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108803328 00000100:00100000:1.0:1782529207.126517:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108803328 00000100:00100000:1.0:1782529207.126564:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 250 00000100:00100000:1.0:1782529207.126574:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:2343:x1869117108803328:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529207.126618:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:2343:x1869117108803328:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 46us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529207.126625:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 250 00000100:00100000:3.0:1782529207.127099:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108803584 00000100:00100000:3.0:1782529207.127107:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108803584 00000100:00100000:3.0:1782529207.127173:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:3.0:1782529207.127182:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108803584:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529207.127224:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108803584:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 45us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529207.127231:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00080000:0.0:1782529207.129948:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529207.698492:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529207.699114:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108803840 00000100:00100000:0.0:1782529207.699129:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108803840 00000100:00100000:0.0:1782529207.699232:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 251 00000100:00100000:0.0:1782529207.699245:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:5561:x1869117108803840:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529207.699268:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529207.699303:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682171a00/0x72bfdc08f7eabd70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addac expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529207.699341:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682171a00/0x72bfdc08f7eabd70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addac expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529207.699355:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682171a00/0x72bfdc08f7eabd70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addac expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529207.699367:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171a00, rc 0) 00000100:00100000:0.0:1782529207.699447:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108803840:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 205us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529207.699455:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 251 00000100:00100000:2.0:1782529207.703722:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529207.703864:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108803968 00000100:00100000:3.0:1782529207.703878:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108803968 00000100:00100000:3.0:1782529207.703955:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 252 00000100:00100000:3.0:1782529207.703968:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108803968:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529207.704604:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108803968:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 634us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529207.704614:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 252 00000100:00100000:2.0:1782529207.714230:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529207.714355:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108804096 00000100:00100000:1.0:1782529207.714369:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108804096 00000100:00100000:1.0:1782529207.714443:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 253 00000100:00100000:1.0:1782529207.714475:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108804096:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.715283:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108804096:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 804us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529207.715302:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 253 00000100:00100000:2.0:1782529207.721265:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529207.721386:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108804224 00000100:00100000:0.0:1782529207.721398:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108804224 00000100:00100000:0.0:1782529207.721469:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 254 00000100:00100000:0.0:1782529207.721479:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:9942:x1869117108804224:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782529207.721794:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:9942:x1869117108804224:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 315us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529207.721803:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 254 00000100:00100000:3.0:1782529207.725133:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529207.726321:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108804352 00000100:00100000:1.0:1782529207.726338:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108804352 00000100:00100000:1.0:1782529207.726425:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 255 00000100:00100000:1.0:1782529207.726437:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c645693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:9942:x1869117108804352:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782529207.726765:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c645693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:9942:x1869117108804352:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 330us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529207.726774:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 255 00000100:00100000:2.0:1782529207.735930:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529207.736348:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108804480 00000100:00100000:3.0:1782529207.736362:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108804480 00000100:00100000:3.0:1782529207.736442:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 256 00000100:00100000:3.0:1782529207.736454:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:5561:x1869117108804480:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529207.736476:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529207.736499:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682045c00/0x72bfdc08f7eabd77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529207.736538:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682045c00/0x72bfdc08f7eabd77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addb3 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529207.736552:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682045c00/0x72bfdc08f7eabd77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addb3 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529207.736562:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045c00, rc 0) 00000100:00100000:3.0:1782529207.736652:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108804480:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 200us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529207.736660:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 256 00000100:00100000:2.0:1782529207.743014:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529207.743393:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108804608 00000100:00100000:0.0:1782529207.743405:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108804608 00000100:00100000:0.0:1782529207.743479:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 257 00000100:00100000:0.0:1782529207.743492:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108804608:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529207.743965:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108804608:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 473us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529207.743975:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 257 00000100:00100000:2.0:1782529207.748997:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529207.749179:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108804736 00000100:00100000:1.0:1782529207.749194:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108804736 00000100:00100000:1.0:1782529207.749260:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 258 00000100:00100000:1.0:1782529207.749272:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108804736:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.749579:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:5561:x1869117108804736:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 307us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529207.749588:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 258 00010000:00010000:2.0:1782529207.751005:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529207.757586:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529207.757965:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108804864 00000100:00100000:3.0:1782529207.757999:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108804864 00000100:00100000:3.0:1782529207.758086:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 259 00000100:00100000:3.0:1782529207.758098:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:9945:x1869117108804864:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782529207.758420:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:9945:x1869117108804864:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 323us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529207.758430:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 259 00000100:00100000:2.0:1782529207.775346:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529207.775454:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108804992 00000100:00100000:0.0:1782529207.775468:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108804992 00000100:00100000:0.0:1782529207.775540:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 260 00000100:00100000:0.0:1782529207.775552:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:9945:x1869117108804992:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782529207.775975:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:9945:x1869117108804992:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 422us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529207.775986:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 260 10000000:01000000:1.0:1782529207.815894:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782529207.815906:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c67f60f000 from 7 10000000:01000000:1.0:1782529207.815913:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529207.815981:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529207.815997:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529207.816038:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529207.816091:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.816198:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529207.816278:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:2.0:1782529207.817995:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117225088 00000100:00100000:2.0:1782529207.818014:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117225088 00000100:00100000:2.0:1782529207.818105:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1782529207.818118:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+16:5791:x1869117117225088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529207.818140:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529207.818180:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d01200/0x72bfdc08f7eabd85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabd7e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529207.818221:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d01200/0x72bfdc08f7eabd85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabd7e expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529207.818236:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d01200/0x72bfdc08f7eabd85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabd7e expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529207.818247:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01200, rc 0) 00000100:00100000:2.0:1782529207.818362:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117225088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.818371:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1782529207.818629:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529207.818653:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529207.818662:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529207.818753:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.818797:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529207.818889:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:3.0:1782529207.819340:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117225216 00000100:00100000:3.0:1782529207.819348:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117225216 00000100:00100000:3.0:1782529207.819396:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1782529207.819406:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117225216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782529207.819772:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117225216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 366us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529207.819780:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782529207.819986:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.820036:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.820099:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529207.820136:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:0.0:1782529207.820209:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117225344 00000100:00100000:0.0:1782529207.820215:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117225344 00000100:00100000:0.0:1782529207.820251:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782529207.820259:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117225344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529207.820462:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117225344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529207.820469:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782529207.820769:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529207.821591:0:11548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11548:1869117117225472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529207.821749:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529207.821898:0:11548:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646391540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529207.823230:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117225472 00000100:00100000:2.0:1782529207.823244:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117225472 00000100:00100000:2.0:1782529207.823384:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1782529207.823397:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:11548:x1869117117225472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529207.823776:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+17:11548:x1869117117225472:12345-0@lo:502:llog_process_th.0 Request processed in 382us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.823785:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1782529207.823927:0:11548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11548:1869117117225472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782529207.823970:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529207.823982:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529207.823985:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782529207.823995:0:11548:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99c67f60f000 00000020:00000080:3.0:1782529207.823997:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782529207.824128:0:11548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11548:1869117117225600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529207.824177:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529207.824778:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117225600 00000100:00100000:0.0:1782529207.824788:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117225600 00000100:00100000:0.0:1782529207.824830:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782529207.824858:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:11548:x1869117117225600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782529207.825268:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:11548:x1869117117225600:12345-0@lo:502:llog_process_th.0 Request processed in 412us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529207.825276:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1782529207.826730:0:11548:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646391540 going to sleep for 11 seconds 00000100:00100000:3.0:1782529207.826781:0:11548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11548:1869117117225600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782529207.826860:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529207.827340:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529207.827344:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782529207.827352:0:11548:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1782529207.827676:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1782529207.827720:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782529207.827733:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529207.827756:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529207.827768:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782529207.827770:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c6795ce000 from 7 10000000:01000000:1.0:1782529207.827773:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529207.827810:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529207.827819:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529207.827830:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529207.827895:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.828091:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529207.828138:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:3.0:1782529207.830400:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117225728 00000100:00100000:3.0:1782529207.830416:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117225728 00000100:00100000:3.0:1782529207.830561:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1782529207.830573:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:5791:x1869117117225728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529207.830595:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529207.830627:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682045200/0x72bfdc08f7eabd93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabd8c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529207.830663:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682045200/0x72bfdc08f7eabd93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabd8c expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529207.830676:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682045200/0x72bfdc08f7eabd93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabd8c expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529207.830687:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045200, rc 0) 00000100:00100000:3.0:1782529207.830777:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117225728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529207.830785:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1782529207.831596:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529207.831638:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529207.831652:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529207.831737:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.831808:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529207.839269:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000100:00100000:2.0:1782529207.839980:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117225856 00000100:00100000:2.0:1782529207.839997:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117225856 00000100:00100000:2.0:1782529207.842439:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782529207.842478:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117225856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529207.842947:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117225856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 490us (11138us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.842957:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782529207.847618:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.847717:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529207.847855:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529207.850426:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143180 going to sleep for 11 seconds 00000040:00080000:1.0:1782529207.851049:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782529207.851533:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117225984 00000100:00100000:3.0:1782529207.851546:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117225984 00000100:00100000:3.0:1782529207.851609:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1782529207.851620:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117225984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529207.852655:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117225984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1029us (4793us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529207.852679:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1782529207.858553:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117225984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529207.859270:0:11552:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11552:1869117117226112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529207.859389:0:11552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529207.859449:0:11552:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f875840 going to sleep for 11 seconds 00000100:00100000:1.0:1782529207.859563:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117226112 00000100:00100000:1.0:1782529207.859572:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117226112 00000100:00100000:1.0:1782529207.859636:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1782529207.859647:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:11552:x1869117117226112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529207.859984:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+18:11552:x1869117117226112:12345-0@lo:502:llog_process_th.0 Request processed in 337us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529207.859993:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782529207.861597:0:11552:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11552:1869117117226112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782529207.861669:0:11552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782529207.861686:0:11552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529207.861688:0:11552:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782529207.861698:0:11552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99c6795ce000 00000020:00000080:2.0:1782529207.861701:0:11552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782529207.861860:0:11552:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11552:1869117117226240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529207.861959:0:11552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529207.862013:0:11552:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f875840 going to sleep for 11 seconds 00000100:00100000:0.0:1782529207.862097:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117226240 00000100:00100000:0.0:1782529207.862112:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117226240 00000100:00100000:0.0:1782529207.862167:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1782529207.862177:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:11552:x1869117117226240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782529207.862442:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:11552:x1869117117226240:12345-0@lo:502:llog_process_th.0 Request processed in 265us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529207.862451:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1782529207.863404:0:11552:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11552:1869117117226240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782529207.863448:0:11552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782529207.863457:0:11552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529207.863460:0:11552:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782529207.863466:0:11552:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1782529207.865951:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1782529207.866004:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782529207.866021:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529207.866037:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529207.866051:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782529207.866055:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c646a6f800 from 7 10000000:01000000:0.0:1782529207.866058:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782529207.866123:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529207.866132:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529207.866143:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529207.866174:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117226368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782529207.866259:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529207.866332:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67fb64300 going to sleep for 11 seconds 00000100:00100000:2.0:1782529207.867152:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117226368 00000100:00100000:2.0:1782529207.867165:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117226368 00000100:00100000:2.0:1782529207.867257:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782529207.867280:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+18:5791:x1869117117226368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529207.867299:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529207.867320:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d01e00/0x72bfdc08f7eabda1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eabd9a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529207.867352:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d01e00/0x72bfdc08f7eabda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eabd9a expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529207.867365:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d01e00/0x72bfdc08f7eabda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eabd9a expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529207.867393:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01e00, rc 0) 00000100:00100000:2.0:1782529207.867467:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117226368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.867475:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1782529207.868551:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117226368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529207.868598:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529207.868611:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529207.868706:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117226496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529207.868768:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529207.868802:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67fb64300 going to sleep for 11 seconds 00000100:00100000:2.0:1782529207.874424:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117226496 00000100:00100000:2.0:1782529207.874444:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117226496 00000100:00100000:2.0:1782529207.874523:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782529207.874534:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117226496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529207.874921:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117226496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 389us (6152us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.874931:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782529207.875002:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117226496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529207.875081:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117226624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529207.875132:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529207.875165:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f875e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782529207.875180:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117226624 00000100:00100000:2.0:1782529207.875183:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117226624 00000100:00100000:2.0:1782529207.875204:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782529207.875210:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117226624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529207.875433:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:5791:x1869117117226624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.875440:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782529207.875473:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:adf301ee-99ae-4756-993e-d61f1989f0b8:5791:1869117117226624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782529207.875674:0:11554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11554:1869117117226752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529207.875709:0:11554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529207.875725:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117226752 00000100:00100000:2.0:1782529207.875729:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117226752 00000100:00100000:2.0:1782529207.875748:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782529207.875753:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:11554:x1869117117226752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529207.875891:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:11554:x1869117117226752:12345-0@lo:502:llog_process_th.0 Request processed in 136us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.875898:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782529207.875923:0:11554:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f875600 going to sleep for 11 seconds 00000100:00100000:2.0:1782529207.875932:0:11554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11554:1869117117226752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782529207.875952:0:11554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782529207.875964:0:11554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529207.875966:0:11554:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782529207.875974:0:11554:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99c646a6f800 00000020:00000080:2.0:1782529207.875977:0:11554:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782529207.876048:0:11554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11554:1869117117226880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529207.876095:0:11554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529207.876113:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117226880 00000100:00100000:2.0:1782529207.876117:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117226880 00000100:00100000:2.0:1782529207.876138:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782529207.876144:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:11554:x1869117117226880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529207.876243:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:11554:x1869117117226880:12345-0@lo:502:llog_process_th.0 Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529207.876250:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1782529207.882363:0:11554:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f875600 going to sleep for 11 seconds 00000100:00100000:3.0:1782529207.882426:0:11554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:adf301ee-99ae-4756-993e-d61f1989f0b8:11554:1869117117226880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782529207.882480:0:11554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529207.882491:0:11554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529207.882494:0:11554:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782529207.882500:0:11554:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782529207.882735:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782529207.882766:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782529207.882781:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529207.882794:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529207.884699:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782529207.884727:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117227008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529207.884810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529207.885367:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117227008 00000100:00100000:3.0:1782529207.885379:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117227008 00000100:00100000:3.0:1782529207.885467:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782529207.885478:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117227008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529207.885661:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529207.885812:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117227008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 336us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529207.885819:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1782529207.885931:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782529207.885984:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677a9df80 x1869117117227008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529207.886003:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117227008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782529208.775557:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782529208.906979:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782529209.799598:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529210.439339:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117227520:0@lo:400:kworker.0 00000100:00100000:0.0:1782529210.439463:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529210.439542:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782529210.439551:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117227136:0@lo:400:kworker.0 00000100:00100000:0.0:1782529210.439588:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529210.439617:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117227648:0@lo:400:kworker.0 00000100:00100000:3.0:1782529210.439631:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117227392:0@lo:400:kworker.0 00000100:00100000:0.0:1782529210.439649:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529210.439687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529210.439716:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782529210.439723:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117227264:0@lo:400:kworker.0 00000100:00100000:3.0:1782529210.439766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529210.439792:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117227776:0@lo:400:kworker.0 00000100:00100000:0.0:1782529210.439811:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117227648 00000100:00100000:3.0:1782529210.439820:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529210.439822:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117227648 00000100:00100000:3.0:1782529210.439892:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117227520 00000100:00100000:3.0:1782529210.439898:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117227520 00000100:00100000:0.0:1782529210.439935:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117227392 00000100:00100000:0.0:1782529210.439940:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117227392 00000100:00100000:3.0:1782529210.439942:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117227776 00000100:00100000:3.0:1782529210.439947:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117227776 00000100:00100000:0.0:1782529210.439968:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117227264 00000100:00100000:0.0:1782529210.439973:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117227264 00000100:00100000:3.0:1782529210.439984:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782529210.439994:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782529210.440000:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117227520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529210.440007:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117227648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529210.440174:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782529210.440185:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117227776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529210.440230:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117227776:12345-0@lo:400:kworker.0 Request processed in 48us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529210.440237:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782529210.440305:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117227520:12345-0@lo:400:kworker.0 Request processed in 309us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529210.440312:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782529210.440356:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782529210.440723:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117227392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529210.440818:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117227392:12345-0@lo:400:kworker.0 Request processed in 454us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529210.440826:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782529210.440880:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782529210.440888:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117227264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529210.440919:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117227264:12345-0@lo:400:kworker.0 Request processed in 32us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529210.440937:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782529210.440965:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117227136 00000100:00100000:3.0:1782529210.440971:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117227136 00000100:00100000:3.0:1782529210.441006:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1782529210.441014:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117227136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529210.441129:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117227136:12345-0@lo:400:kworker.0 Request processed in 115us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529210.441136:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:3.0:1782529210.441231:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782529210.441238:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782529210.441242:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529210.441329:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782529210.441345:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117227904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529210.441808:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117227136:0@lo:400:kworker.0 00000100:00100000:1.0:1782529210.441827:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117227648:0@lo:400:kworker.0 00000100:00100000:1.0:1782529210.441879:0:3294:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1782529210.441884:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c67fae4000, transno 4294967300 00000100:00100000:1.0:1782529210.441897:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117227520:0@lo:400:kworker.0 00000100:00100000:2.0:1782529210.442263:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117227264:0@lo:400:kworker.0 00010000:00080000:2.0:1782529210.442283:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680cdfb80 x1869117117227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529210.442296:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117227776:0@lo:400:kworker.0 00000100:00100000:2.0:1782529210.442311:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117227392:0@lo:400:kworker.0 00000100:00100000:0.0:1782529210.442950:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117227648:12345-0@lo:400:kworker.0 Request processed in 2942us (3296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529210.442964:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782529210.445893:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529210.445994:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117227904 00000100:00100000:3.0:1782529210.446006:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117227904 00000100:00100000:3.0:1782529210.446085:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782529210.446097:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117227904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529210.446149:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529210.446209:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117227904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529210.446217:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782529210.446300:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117227904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782529210.825146:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529211.848477:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529212.239357:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529212.239555:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108805248 00000100:00100000:3.0:1782529212.239570:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108805248 00000100:00100000:3.0:1782529212.240006:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 110 00000100:00100000:3.0:1782529212.240021:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108805248:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529212.240313:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108805248:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 294us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529212.240322:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 110 00000100:00100000:3.0:1782529212.245934:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529212.245984:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529212.246016:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529212.247328:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108805376 00000100:00100000:1.0:1782529212.247348:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108805376 00000100:00100000:2.0:1782529212.247448:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108805120 00000100:00100000:2.0:1782529212.247454:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108805120 00000100:00100000:2.0:1782529212.247534:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 277 00000100:00100000:2.0:1782529212.247545:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108805120:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529212.247662:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108805120:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 118us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529212.247671:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 277 00000100:00100000:2.0:1782529212.247925:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108805504 00000100:00100000:2.0:1782529212.247930:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108805504 00000100:00100000:1.0:1782529212.252785:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:1.0:1782529212.252812:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108805376:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529212.252953:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108805376:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 151us (6966us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529212.252961:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:2.0:1782529212.253532:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 111 00000100:00100000:2.0:1782529212.253549:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108805504:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529212.253602:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108805504:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 60us (7585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529212.253610:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 111 00000100:00080000:0.0:1782529212.262286:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782529212.262305:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782529212.871477:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529213.001110:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117228032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529213.001241:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529213.001527:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117228032 00000100:00100000:2.0:1782529213.001559:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117228032 00000100:00100000:2.0:1782529213.001650:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782529213.001666:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117228032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529213.001716:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529213.001773:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117228032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529213.001780:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1782529213.001914:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677a9dc00 x1869117117228032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529213.001936:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117228032:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782529213.003441:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782529213.896780:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529214.919156:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529215.559618:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117228544:0@lo:400:kworker.0 00000100:00100000:0.0:1782529215.559733:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529215.559824:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782529215.559852:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117228160:0@lo:400:kworker.0 00000100:00100000:0.0:1782529215.559890:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529215.559912:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117228672:0@lo:400:kworker.0 00000100:00100000:0.0:1782529215.559937:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529215.559978:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117228672 00000100:00100000:0.0:1782529215.559988:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117228672 00000100:00100000:0.0:1782529215.560077:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782529215.560087:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117228672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529215.560147:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117228672:12345-0@lo:400:kworker.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529215.560156:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1782529215.560205:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529215.560242:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117228672:0@lo:400:kworker.0 00000100:00100000:1.0:1782529215.560627:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117228544 00000100:00100000:1.0:1782529215.560632:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117228544 00000100:00100000:1.0:1782529215.560686:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782529215.560693:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117228544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529215.560734:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117228544:12345-0@lo:400:kworker.0 Request processed in 42us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529215.560741:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1782529215.560863:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529215.560886:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117228544:0@lo:400:kworker.0 00000100:00100000:2.0:1782529215.561776:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117228416:0@lo:400:kworker.0 00000100:00100000:2.0:1782529215.561883:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529215.561921:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782529215.561927:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117228288:0@lo:400:kworker.0 00000100:00100000:2.0:1782529215.561949:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529215.561963:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117228800:0@lo:400:kworker.0 00000100:00100000:2.0:1782529215.561983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529215.562122:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117228288 00000100:00100000:0.0:1782529215.562129:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117228288 00000100:00100000:0.0:1782529215.562171:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782529215.562189:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117228288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529215.562249:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117228288:12345-0@lo:400:kworker.0 Request processed in 61us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529215.562274:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782529215.563153:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117228416 00000100:00100000:2.0:1782529215.563165:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117228416 00000100:00100000:2.0:1782529215.563361:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782529215.563370:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117228416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529215.563438:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117228416:12345-0@lo:400:kworker.0 Request processed in 70us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529215.563445:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782529215.563510:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117228288:0@lo:400:kworker.0 00000100:00100000:2.0:1782529215.563525:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117228416:0@lo:400:kworker.0 00000100:00100000:1.0:1782529215.564481:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117228800 00000100:00100000:1.0:1782529215.564493:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117228800 00000100:00100000:1.0:1782529215.564559:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782529215.564584:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117228800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529215.564667:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117228800:12345-0@lo:400:kworker.0 Request processed in 84us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529215.564674:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1782529215.564928:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680a40e00 x1869117117228800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529215.564956:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117228800:0@lo:400:kworker.0 00000100:00100000:3.0:1782529215.565542:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117228160 00000100:00100000:3.0:1782529215.565551:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117228160 00000100:00100000:3.0:1782529215.565595:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1782529215.565604:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117228160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529215.565804:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117228160:12345-0@lo:400:kworker.0 Request processed in 200us (5912us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529215.565811:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1782529215.565909:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117228160:0@lo:400:kworker.0 00000100:00080000:0.0:1782529215.566435:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782529215.566443:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529215.570458:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117228928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529215.570576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529215.570877:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117228928 00000100:00100000:1.0:1782529215.570889:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117228928 00000100:00100000:1.0:1782529215.570968:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782529215.570980:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117228928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782529215.571052:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529215.571133:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117228928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529215.571141:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782529215.572159:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117228928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782529215.943160:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529216.967210:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529217.362997:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529217.363040:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529217.363093:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529217.363138:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529217.363184:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108805888 00000100:00100000:2.0:1782529217.363199:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108805888 00000100:00100000:2.0:1782529217.363287:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:2.0:1782529217.363304:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108805888:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529217.363402:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108805888:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 105us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529217.363411:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:1.0:1782529217.363713:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108805632 00000100:00100000:1.0:1782529217.363719:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108805632 00000100:00100000:1.0:1782529217.363759:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 279 00000100:00100000:1.0:1782529217.363766:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108805632:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529217.363807:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108805632:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 41us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529217.363813:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 279 00000100:00100000:3.0:1782529217.363968:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108805760 00000100:00100000:3.0:1782529217.363973:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108805760 00000100:00100000:3.0:1782529217.364028:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108806016 00000100:00100000:3.0:1782529217.364032:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108806016 00000100:00100000:3.0:1782529217.364057:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:3.0:1782529217.364066:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108805760:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529217.364105:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108805760:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 41us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529217.364112:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:3.0:1782529217.364127:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:3.0:1782529217.364153:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108806016:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529217.364181:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108806016:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529217.364187:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00080000:0.0:1782529217.364376:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782529217.364382:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782529217.991965:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782529218.119763:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782529218.120566:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117229056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529218.120674:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529218.120909:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117229056 00000100:00100000:3.0:1782529218.120918:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117229056 00000100:00100000:3.0:1782529218.121022:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782529218.121033:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117229056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529218.121085:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529218.121138:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117229056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529218.121146:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1782529218.121336:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677a9d500 x1869117117229056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529218.121359:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117229056:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782529218.121388:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782529219.015889:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529220.039214:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529220.679093:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117229184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529220.679211:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529220.679328:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117229184 00000100:00100000:3.0:1782529220.679338:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117229184 00000100:00100000:3.0:1782529220.679411:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782529220.679423:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117229184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529220.679471:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529220.679539:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117229184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529220.679547:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1782529220.679570:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529220.679611:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117229184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529220.679899:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117229440:0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.679938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529220.679979:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782529220.679985:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117229312:0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680020:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529220.680048:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117229824:0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680099:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529220.680132:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117229312 00000100:00100000:2.0:1782529220.680136:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117229312 00000100:00100000:2.0:1782529220.680174:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1782529220.680181:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117229312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680220:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117229312:12345-0@lo:400:kworker.0 Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529220.680227:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1782529220.680257:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117229824 00000100:00100000:2.0:1782529220.680261:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117229824 00000100:00100000:2.0:1782529220.680299:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782529220.680307:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117229824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680338:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117229824:12345-0@lo:400:kworker.0 Request processed in 33us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529220.680344:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782529220.680348:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117229568:0@lo:400:kworker.0 00000100:00080000:2.0:1782529220.680365:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529220.680382:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117229312:0@lo:400:kworker.0 00000100:00100000:0.0:1782529220.680382:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782529220.680395:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c680008700 x1869117117229824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529220.680402:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782529220.680407:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117229824:0@lo:400:kworker.0 00000100:00100000:0.0:1782529220.680408:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67868ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117229696:0@lo:400:kworker.0 00000100:00100000:0.0:1782529220.680429:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529220.680568:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117229440 00000100:00100000:2.0:1782529220.680572:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117229440 00000100:00100000:2.0:1782529220.680603:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117229568 00000100:00100000:2.0:1782529220.680607:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117229568 00000100:00100000:2.0:1782529220.680625:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117229696 00000100:00100000:2.0:1782529220.680628:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117229696 00000100:00100000:2.0:1782529220.680642:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782529220.680659:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117229440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680697:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117229440:12345-0@lo:400:kworker.0 Request processed in 40us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529220.680704:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782529220.680716:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782529220.680723:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117229568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680771:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117229568:12345-0@lo:400:kworker.0 Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529220.680776:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782529220.680788:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782529220.680794:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117229696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680821:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117229696:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529220.680827:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1782529220.680864:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529220.680883:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67868ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117229696:0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680894:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117229568:0@lo:400:kworker.0 00000100:00100000:2.0:1782529220.680918:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117229440:0@lo:400:kworker.0 00010000:00010000:2.0:1782529221.067689:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529222.089809:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529222.481089:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529222.481157:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529222.481683:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108806272 00000100:00100000:0.0:1782529222.481696:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108806272 00000100:00100000:0.0:1782529222.481886:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:0.0:1782529222.481899:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108806272:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529222.482959:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108806144 00000100:00100000:3.0:1782529222.482989:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108806144 00000100:00100000:3.0:1782529222.483045:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 281 00000100:00100000:3.0:1782529222.483054:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108806144:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529222.483114:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108806144:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 62us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529222.483122:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 281 00000100:00100000:0.0:1782529222.483697:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108806272:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 122us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529222.483709:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00080000:2.0:1782529222.484315:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529222.499553:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529222.499623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529222.499776:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108806400 00000100:00100000:1.0:1782529222.499791:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108806400 00000100:00100000:1.0:1782529222.499915:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:1.0:1782529222.499929:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2340:x1869117108806400:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:1.0:1782529222.499983:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabcdd 00000100:00080000:1.0:1782529222.499994:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c67734a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782529222.500053:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1782529222.500471:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+2:2340:x1869117108806400:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 544us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529222.500481:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00010000:00010000:1.0:1782529222.500666:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782529222.500706:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529222.503896:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108806528 00000100:00100000:3.0:1782529222.503917:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108806528 00000100:00100000:3.0:1782529222.504100:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:3.0:1782529222.504113:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108806528:12345-192.168.202.50@tcp:400:kworker.0 00000100:00080000:0.0:1782529222.504209:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529222.504241:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108806528:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 130us (4617us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529222.504251:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 121 00010000:00010000:2.0:1782529223.112306:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529223.242424:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782529223.242487:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117229952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529223.242821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529223.242890:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117229952 00000100:00100000:1.0:1782529223.242900:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117229952 00000100:00100000:1.0:1782529223.243038:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782529223.243052:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117229952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782529223.243104:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529223.243174:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117229952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529223.243182:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1782529223.243366:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677a9c380 x1869117117229952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529223.243391:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117229952:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782529223.244339:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782529224.137059:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529225.159237:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529225.800233:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117230336:0@lo:400:kworker.0 00000100:00100000:0.0:1782529225.800332:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529225.800415:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782529225.800423:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117230464:0@lo:400:kworker.0 00000100:00100000:0.0:1782529225.800484:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529225.800718:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117230336 00000100:00100000:0.0:1782529225.800729:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117230336 00000100:00100000:0.0:1782529225.800802:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782529225.800813:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117230336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529225.800931:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117230336:12345-0@lo:400:kworker.0 Request processed in 119us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529225.800938:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782529225.800971:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117230464 00000100:00100000:0.0:1782529225.800975:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117230464 00000100:00100000:0.0:1782529225.801003:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782529225.801008:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117230464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529225.801040:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117230464:12345-0@lo:400:kworker.0 Request processed in 32us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529225.801046:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1782529225.801064:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782529225.801070:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529225.801159:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117230464:0@lo:400:kworker.0 00000100:00100000:0.0:1782529225.801172:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117230336:0@lo:400:kworker.0 00000100:00100000:1.0:1782529225.801358:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117230208:0@lo:400:kworker.0 00000100:00100000:1.0:1782529225.801398:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529225.801429:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117230720:0@lo:400:kworker.0 00000100:00100000:1.0:1782529225.801451:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529225.801471:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782529225.801477:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c646b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117230080:0@lo:400:kworker.0 00000100:00100000:1.0:1782529225.801508:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529225.801721:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117230592:0@lo:400:kworker.0 00000100:00100000:1.0:1782529225.801751:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529225.801781:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117230720 00000100:00100000:1.0:1782529225.801785:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117230720 00000100:00100000:1.0:1782529225.801826:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782529225.801861:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117230720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529225.801928:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117230720:12345-0@lo:400:kworker.0 Request processed in 96us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529225.801936:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782529225.801959:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117230080 00000100:00100000:1.0:1782529225.801962:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117230080 00000100:00100000:1.0:1782529225.801986:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1782529225.801992:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117230080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529225.802023:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117230080:12345-0@lo:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529225.802029:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1782529225.802058:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529225.802078:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c646b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117230080:0@lo:400:kworker.0 00010000:00080000:1.0:1782529225.802093:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c6773b1880 x1869117117230720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529225.802104:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117230720:0@lo:400:kworker.0 00000100:00100000:3.0:1782529225.802394:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117230208 00000100:00100000:3.0:1782529225.802399:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117230208 00000100:00100000:3.0:1782529225.802431:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117230592 00000100:00100000:3.0:1782529225.802435:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117230592 00000100:00100000:3.0:1782529225.802469:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782529225.802478:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117230208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529225.802537:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117230208:12345-0@lo:400:kworker.0 Request processed in 60us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529225.802544:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1782529225.802973:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782529225.802985:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117230848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529225.803023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782529225.803086:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529225.803132:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782529225.803145:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117230592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529225.803185:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117230592:12345-0@lo:400:kworker.0 Request processed in 45us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529225.803192:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782529225.803243:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117230592:0@lo:400:kworker.0 00000100:00100000:0.0:1782529225.803257:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117230208:0@lo:400:kworker.0 00000100:00100000:2.0:1782529225.810490:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117230848 00000100:00100000:2.0:1782529225.810512:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117230848 00000100:00100000:2.0:1782529225.810606:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782529225.810619:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117230848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529225.810671:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529225.810783:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117230848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (7758us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529225.810792:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782529225.812001:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117230848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782529226.190548:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782529226.409537:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:3.0:1782529226.409548:0:6618:0:(genops.c:906:class_export_put()) final put ffff99c67f35f000/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:2.0:1782529226.409614:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f35f000/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 for lustre-OST0000 00000020:00000080:2.0:1782529226.409728:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c67734a800 for lustre-OST0000 00010000:00010000:2.0:1782529227.209168:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529227.605206:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529227.605264:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529227.605293:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529227.607432:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108806656 00000100:00100000:3.0:1782529227.607460:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108806656 00000100:00100000:3.0:1782529227.607639:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 283 00000100:00100000:3.0:1782529227.607652:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108806656:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529227.607754:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108806656:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 105us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529227.607763:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 283 00000100:00100000:3.0:1782529227.608031:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108806912 00000100:00100000:3.0:1782529227.608036:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108806912 00000100:00100000:3.0:1782529227.608081:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108806784 00000100:00100000:3.0:1782529227.608085:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108806784 00000100:00100000:3.0:1782529227.608109:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:3.0:1782529227.608116:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108806912:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529227.608175:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108806912:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 58us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529227.608182:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:3.0:1782529227.608198:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:3.0:1782529227.608204:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2342:x1869117108806784:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529227.608231:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2342:x1869117108806784:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529227.608237:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00080000:3.0:1782529227.611159:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782529228.233135:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529228.361763:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782529228.362119:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117230976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782529228.362208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529228.362378:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117230976 00000100:00100000:1.0:1782529228.362388:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117230976 00000040:00080000:0.0:1782529228.362429:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782529228.362679:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782529228.362691:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117230976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529228.362726:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529228.362786:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117230976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529228.362794:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1782529228.362946:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677a9c380 x1869117117230976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529228.362967:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117230976:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782529228.371883:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782529229.254977:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782529229.888458:0:11716:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:00:28 (1782529228) 00010000:00010000:3.0:1782529230.279408:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529230.920745:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117231104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529230.920904:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529230.922627:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117231104 00000100:00100000:1.0:1782529230.922642:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117231104 00000100:00100000:1.0:1782529230.922737:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782529230.922749:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117231104:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529230.922957:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117231232:0@lo:400:kworker.0 00000100:00100000:0.0:1782529230.923700:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529230.923785:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117231232 00002000:00000024:1.0:1782529230.923923:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529230.924030:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117231232 00000100:00100000:0.0:1782529230.924079:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1782529230.924087:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117231232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529230.924130:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117231232:12345-0@lo:400:kworker.0 Request processed in 44us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529230.924138:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1782529230.924210:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117231232:0@lo:400:kworker.0 00000100:00080000:0.0:1782529230.925390:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529230.932240:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117231360:0@lo:400:kworker.0 00000100:00100000:2.0:1782529230.932345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529230.932446:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117231360 00000100:00100000:2.0:1782529230.932455:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117231360 00000100:00100000:2.0:1782529230.932517:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1782529230.932527:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117231360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529230.932614:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117231360:12345-0@lo:400:kworker.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529230.932621:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1782529230.932673:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117231360:0@lo:400:kworker.0 00000100:00100000:2.0:1782529230.932719:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67868ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117231488:0@lo:400:kworker.0 00000100:00100000:2.0:1782529230.932745:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529230.932777:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117231488 00000100:00100000:2.0:1782529230.932781:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117231488 00000100:00100000:2.0:1782529230.932823:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782529230.932830:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117231488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529230.932918:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117231488:12345-0@lo:400:kworker.0 Request processed in 89us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529230.932925:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782529230.932963:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67868ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117231488:0@lo:400:kworker.0 00000100:00080000:2.0:1782529230.932984:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529230.933434:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67868ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117231616:0@lo:400:kworker.0 00000100:00100000:0.0:1782529230.934136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529230.934410:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117231616 00000100:00100000:3.0:1782529230.934418:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117231616 00000100:00100000:3.0:1782529230.935273:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782529230.935287:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117231616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529230.939435:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117231104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 16678us (18521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529230.939456:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1782529230.939566:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529230.941944:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117231744:0@lo:400:kworker.0 00000100:00100000:2.0:1782529230.942115:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529230.942200:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117231744 00000100:00100000:2.0:1782529230.942209:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117231744 00000100:00100000:2.0:1782529230.942290:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782529230.942302:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117231744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529230.942367:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117231744:12345-0@lo:400:kworker.0 Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529230.942377:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1782529230.942817:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae7100 x1869117117231744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782529246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782529230.943273:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529230.947235:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117231616:12345-0@lo:400:kworker.0 Request processed in 11942us (13089us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529230.947250:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782529230.947303:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117231744:0@lo:400:kworker.0 00000100:00100000:0.0:1782529230.947476:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117231104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529230.947597:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67868ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117231616:0@lo:400:kworker.0 00010000:00010000:2.0:1782529231.303219:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529231.666062:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529231.666224:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108807040 00000100:00100000:1.0:1782529231.666239:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108807040 00000100:00100000:1.0:1782529231.666572:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1782529231.666586:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:10214:x1869117108807040:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782529231.666626:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529231.666661:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabda8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addba expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.666757:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabdaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.666775:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.666791:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529231.667264:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782529231.667277:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529231.667386:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.667421:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabda8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addba expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.667443:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabdaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addba expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.667453:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c643b34a00) 00010000:00010000:1.0:1782529231.667456:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782529231.667460:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7c00, rc 0) 00000100:00100000:1.0:1782529231.667548:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:10214:x1869117108807040:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 965us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529231.667557:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00080000:2.0:1782529231.668672:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529231.675356:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529231.675558:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108807168 00000100:00100000:1.0:1782529231.675574:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108807168 00000100:00100000:1.0:1782529231.675651:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:1.0:1782529231.675673:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:10215:x1869117108807168:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782529231.675703:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529231.675731:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabdb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addc1 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.675823:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.675885:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.675921:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.675939:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.675958:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.675964:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676438:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7200/0x72bfdc08f7eabdcb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676449:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7200/0x72bfdc08f7eabdcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676457:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7200/0x72bfdc08f7eabdcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529231.676554:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782529231.676559:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529231.676644:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7200/0x72bfdc08f7eabdcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676658:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676665:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676680:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676686:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529231.676691:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676700:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676717:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c643b34a00) 00010000:00010000:1.0:1782529231.676721:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529231.676726:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676733:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eabdbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676747:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676754:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676760:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676764:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529231.676767:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676782:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676791:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99c643b34000) 00010000:00010000:1.0:1782529231.676794:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529231.676797:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676802:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabdc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676915:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabdb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addc1 expref: 8 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676931:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7200/0x72bfdc08f7eabdcb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addc1 expref: 7 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529231.676938:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99c643b34c00) 00010000:00010000:1.0:1782529231.676940:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782529231.676943:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7200, rc 0) 00000100:00100000:1.0:1782529231.677033:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:10215:x1869117108807168:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1362us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529231.677042:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:3.0:1782529231.707966:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529231.708233:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108807424 00000100:00100000:0.0:1782529231.708246:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108807424 00000100:00100000:0.0:1782529231.708331:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:0.0:1782529231.708344:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:10215:x1869117108807424:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529231.708374:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529231.708402:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabdd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addc8 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.708523:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.708542:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.708555:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.708740:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.708763:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.708774:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709566:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabde7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709578:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabde7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709586:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabde7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529231.709597:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782529231.709767:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709775:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709782:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709788:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529231.709792:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709798:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709810:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99c643b34c00) 00010000:00010000:0.0:1782529231.709813:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529231.709816:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709830:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabdd9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709875:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709958:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709965:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709970:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529231.709973:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709979:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709988:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99c642b0f500) 00010000:00010000:0.0:1782529231.709990:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529231.709992:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.709997:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabde0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.710674:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabdd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addc8 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.710692:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabde7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addc8 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529231.710706:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:0.0:1782529231.710708:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529231.710711:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170600, rc 0) 00000100:00100000:0.0:1782529231.710799:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:10215:x1869117108807424:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 2456us (2855us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1782529231.710809:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:2.0:1782529231.727209:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529231.736964:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108807552 00000100:00100000:1.0:1782529231.736980:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108807552 00000100:00100000:1.0:1782529231.737055:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:1.0:1782529231.737067:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:10215:x1869117108807552:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1782529231.737209:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:10215:x1869117108807552:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 145us (10010us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529231.737218:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00010000:00010000:2.0:1782529232.328500:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782529232.456123:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782529232.721600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529232.721665:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529232.721704:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529232.721792:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108807808 00000100:00100000:2.0:1782529232.721805:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108807808 00000100:00100000:2.0:1782529232.721904:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108807936 00000100:00100000:2.0:1782529232.721908:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108807936 00000100:00100000:2.0:1782529232.721951:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 130 00000100:00100000:2.0:1782529232.721963:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2342:x1869117108807808:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529232.722072:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2342:x1869117108807808:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 110us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529232.722081:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 130 00000100:00100000:2.0:1782529232.722101:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:2.0:1782529232.722108:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108807936:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529232.722134:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108807936:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529232.722154:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00080000:2.0:1782529232.722175:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529232.722494:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108807680 00000100:00100000:0.0:1782529232.722500:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108807680 00000100:00100000:0.0:1782529232.722541:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 285 00000100:00100000:0.0:1782529232.722549:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108807680:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529232.722586:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108807680:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 39us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529232.722593:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 285 00010000:00010000:1.0:1782529233.354774:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529233.479277:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782529233.479310:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117231872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529233.479406:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529233.479597:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117231872 00000100:00100000:1.0:1782529233.479607:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117231872 00000100:00100000:1.0:1782529233.479686:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782529233.479696:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117231872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782529233.479747:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529233.479808:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117231872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529233.479816:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1782529233.479912:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782529233.480033:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c677a9f800 x1869117117231872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529233.480055:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117231872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529233.818108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529233.818611:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108808064 00000100:00100000:3.0:1782529233.818625:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108808064 00000100:00100000:3.0:1782529233.818728:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:3.0:1782529233.818742:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:10258:x1869117108808064:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1782529233.818769:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529233.818797:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabdf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addcf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.818917:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.818936:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.818970:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.818987:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.818994:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819001:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819308:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819317:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819324:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819331:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529233.819335:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819344:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819359:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c643b34a00) 00010000:00010000:3.0:1782529233.819362:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529233.819367:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819385:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabdfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819399:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819404:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819410:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819414:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529233.819417:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819423:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819432:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99c6601f9100) 00010000:00010000:3.0:1782529233.819435:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529233.819437:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819442:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabe03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819483:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabdf5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addcf expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819506:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c643b34a00) 00010000:00010000:3.0:1782529233.819508:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529233.819512:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabdf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addcf expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.819522:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:3.0:1782529233.819610:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:10258:x1869117108808064:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 870us (1517us total) trans 0 rc 301/301 00000100:00100000:3.0:1782529233.819619:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00080000:2.0:1782529233.819957:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529233.826292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529233.826386:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108808320 00000100:00100000:3.0:1782529233.826399:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108808320 00000100:00100000:3.0:1782529233.826474:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:3.0:1782529233.826486:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:10258:x1869117108808320:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:3.0:1782529233.826658:0:6616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529233.826693:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabdaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addba expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.826715:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c643b34a00) 00010000:00010000:3.0:1782529233.826729:0:6616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529233.833014:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.833046:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.833059:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.833086:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.833093:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.833100:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529233.834233:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782529233.834250:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.834260:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.834268:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.834276:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529233.834281:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.834290:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.834309:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:3.0:1782529233.834313:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529233.834318:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.834335:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe0a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782529233.834362:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad3baf71 reply state 000000003b0dbc4b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529233.834373:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529233.834537:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:10258:x1869117108808320:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 8047us (8255us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782529233.834548:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00010000:00010000:2.0:1782529233.852524:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529233.852559:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529233.852567:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529233.852575:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529233.852581:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529233.852589:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529233.852610:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99c6601f9f00) 00010000:00010000:2.0:1782529233.852614:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529233.852618:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529233.852625:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabe11 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529233.928546:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529233.929010:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108808448 00000100:00100000:3.0:1782529233.929025:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108808448 00000100:00100000:3.0:1782529233.929106:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:3.0:1782529233.929118:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:10266:x1869117108808448:12345-192.168.202.50@tcp:101:lctl.0 00010000:00010000:3.0:1782529233.929153:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529233.929183:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addd6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.929276:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabe1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.929292:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabe1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.929306:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabe1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529233.929403:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782529233.929408:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782529233.929659:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabe1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.929689:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabe18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addd6 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.929710:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabe1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addd6 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529233.929720:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:3.0:1782529233.929724:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782529233.929728:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:3.0:1782529233.929810:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:10266:x1869117108808448:12345-192.168.202.50@tcp:101:lctl.0 Request processed in 693us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529233.929818:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:0.0:1782529234.021627:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529234.025519:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108808576 00000100:00100000:2.0:1782529234.025539:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108808576 00000100:00100000:2.0:1782529234.025629:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:2.0:1782529234.025641:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:10272:x1869117108808576:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529234.025666:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529234.025692:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabe26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adddd expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.025794:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.025811:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.025826:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029036:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029058:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029073:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029235:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabe3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029243:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabe3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029251:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabe3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529234.029303:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782529234.029308:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529234.029362:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabe3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029392:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029400:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029408:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029414:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529234.029420:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029428:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029445:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:2.0:1782529234.029449:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529234.029469:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029476:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029492:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029499:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029505:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029648:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529234.029652:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029659:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029667:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99c669568c00) 00010000:00010000:2.0:1782529234.029669:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529234.029672:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029678:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029727:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabe26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adddd expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029746:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabe3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adddd expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.029754:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529234.029757:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782529234.029759:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00600, rc 0) 00000100:00100000:2.0:1782529234.029897:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:10272:x1869117108808576:12345-192.168.202.50@tcp:101:bash.0 Request processed in 4256us (9402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529234.029908:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:0.0:1782529234.039742:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529234.040346:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108808832 00000100:00100000:2.0:1782529234.040367:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108808832 00000100:00100000:2.0:1782529234.040441:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:2.0:1782529234.040452:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:10272:x1869117108808832:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529234.040482:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529234.040520:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabe42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adde4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.040700:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.040719:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.040732:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.040749:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.040756:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.040763:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782529234.041477:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1782529234.041677:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041690:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041709:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041754:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041761:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041768:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041775:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529234.041780:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041788:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041802:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529234.041805:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529234.041810:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041815:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eabe49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529234.041828:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ca91477 reply state 00000000dd918a69 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529234.041875:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782529234.041923:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabe42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041939:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.041946:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568000) 00010000:00010000:2.0:1782529234.041948:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529234.041951:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01a00, rc 0) 00000100:00100000:2.0:1782529234.042048:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:10272:x1869117108808832:12345-192.168.202.50@tcp:101:bash.0 Request processed in 1597us (2321us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1782529234.042058:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00010000:00010000:3.0:1782529234.043940:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.043959:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.043967:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.043975:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529234.043982:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.043990:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.044026:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568c00) 00010000:00010000:3.0:1782529234.044029:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529234.044035:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.044041:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabe50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529234.054751:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529234.055619:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108808960 00000100:00100000:1.0:1782529234.055632:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108808960 00000100:00100000:1.0:1782529234.055689:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:1.0:1782529234.055700:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1869117108808960:12345-192.168.202.50@tcp:8:bash.0 00010000:00080000:1.0:1782529234.055742:0:6591:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:1.0:1782529234.055798:0:6591:0:(genops.c:1406:class_connect()) connect: client 089f7aa7-7be0-48a9-8829-cfc80cd2ee18, cookie 0x72bfdc08f7eabe65 00002000:00100000:1.0:1782529234.055812:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 089f7aa7-7be0-48a9-8829-cfc80cd2ee18/ffff99c680351800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782529234.055824:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782529234.056156:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782529234.056204:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c680351000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529234.056282:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2340:x1869117108808960:12345-192.168.202.50@tcp:8:bash.0 Request processed in 582us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529234.056291:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1782529234.068733:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529234.068903:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108809088 00000100:00100000:2.0:1782529234.068916:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108809088 00000100:00100000:2.0:1782529234.069004:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:2.0:1782529234.069016:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:0:x1869117108809088:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529234.069040:0:8328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529234.069085:0:8328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addeb expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529234.069123:0:8328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782529234.069147:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=295s v=(0 0) 00010000:00010000:2.0:1782529234.069152:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529234.069164:0:8328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 7 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.069189:0:8328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 7 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.069226:0:8328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00c00, rc 0) 00000100:00100000:2.0:1782529234.069297:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:0:x1869117108809088:12345-192.168.202.50@tcp:101:bash.0 Request processed in 282us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529234.069305:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00080000:1.0:1782529234.070041:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529234.074759:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529234.076440:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108809216 00000100:00100000:1.0:1782529234.076462:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108809216 00000100:00100000:1.0:1782529234.076562:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:1.0:1782529234.076575:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:10272:x1869117108809216:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1782529234.076603:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529234.076727:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addf2 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.076774:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 8 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.076804:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529234.076809:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529234.076816:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.076908:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 8 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.076924:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 8 pid: 8328 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529234.076943:0:6592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1869117117232000:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529234.077084:0:6592:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c65411da80 going to sleep for 11 seconds 00000100:00100000:0.0:1782529234.080658:0:6592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1869117117232000:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529234.080659:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00010000:00010000:0.0:1782529234.080706:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.080736:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170a00, rc 0) 00000100:00100000:0.0:1782529234.080811:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:10272:x1869117108809216:12345-192.168.202.50@tcp:101:bash.0 Request processed in 4238us (6067us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529234.080821:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:3.0:1782529234.082189:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108809344 00000100:00100000:3.0:1782529234.082204:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108809344 00010000:00010000:3.0:1782529234.082327:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 8 pid: 8328 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529234.082376:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:3.0:1782529234.082387:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108809344:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529234.082406:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529234.082434:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 8 pid: 8328 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.082450:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 8 pid: 8328 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.082483:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002914330b/0x72bfdc08f7eabe6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addeb expref: 8 pid: 8328 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.082505:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529234.082526:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529234.082536:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.082547:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.082595:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529234.082612:0:5778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1869117117232128:192.168.202.50@tcp:105: 00000100:00100000:3.0:1782529234.082720:0:5778:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fef540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529234.101685:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529234.101801:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108809600 00000100:00100000:1.0:1782529234.101814:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108809600 00000100:00100000:1.0:1782529234.101923:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1782529234.101934:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:10272:x1869117108809600:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:1.0:1782529234.102413:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:10272:x1869117108809600:12345-192.168.202.50@tcp:35:bash.0 Request processed in 479us (739us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1782529234.102421:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:3.0:1782529234.103595:0:5778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1869117117232128:192.168.202.50@tcp:105: 00010000:00010000:3.0:1782529234.103626:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529234.103686:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108809344:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 21301us (23038us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529234.103697:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:2.0:1782529234.209619:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529234.212547:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108809856 00000100:00100000:0.0:1782529234.212569:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108809856 00000100:00100000:0.0:1782529234.212676:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:0.0:1782529234.212712:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:10282:x1869117108809856:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529234.212752:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529234.212781:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabe7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0addf9 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529234.216637:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782529234.216996:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabe7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf9 expref: 16 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.217022:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:3.0:1782529234.217027:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782529234.217034:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabe7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf9 expref: 16 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.217055:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170000, rc 0) 00000100:00100000:3.0:1782529234.217504:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:10282:x1869117108809856:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 4792us (7896us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1782529234.217526:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:2.0:1782529234.224496:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529234.224734:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108810112 00000100:00100000:1.0:1782529234.224749:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108810112 00000100:00100000:1.0:1782529234.224825:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:1.0:1782529234.225123:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:10282:x1869117108810112:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529234.225705:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:10282:x1869117108810112:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 587us (1222us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1782529234.225716:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:1.0:1782529234.323993:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529234.324555:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108810240 00000100:00100000:2.0:1782529234.324570:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108810240 00000100:00100000:2.0:1782529234.324690:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1782529234.324704:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:10288:x1869117108810240:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529234.324736:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529234.324762:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eabe88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade00 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.324914:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabe8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.324932:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabe8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.324947:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabe8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529234.325026:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782529234.325046:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529234.325079:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabe8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.325111:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eabe88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade00 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.325133:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabe8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade00 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.325143:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529234.325146:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529234.325150:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529234.325217:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:10288:x1869117108810240:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 516us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529234.325225:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1782529234.336650:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529234.336764:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108810496 00000100:00100000:0.0:1782529234.336778:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108810496 00000100:00100000:0.0:1782529234.336897:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:0.0:1782529234.336909:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:10288:x1869117108810496:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529234.336937:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529234.336965:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabe96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade07 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.337104:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabe9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.337122:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabe9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.337136:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabe9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529234.337151:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782529234.337338:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabe96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade07 expref: 20 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.337361:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabe9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade07 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.337393:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568000) 00010000:00010000:0.0:1782529234.337396:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529234.337399:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170400, rc 0) 00000100:00100000:0.0:1782529234.337480:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10288:x1869117108810496:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 572us (842us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1782529234.337489:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:0.0:1782529234.344791:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529234.344886:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529234.344988:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108810624 00000100:00100000:3.0:1782529234.345001:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108810624 00000100:00100000:3.0:1782529234.345088:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1782529234.345100:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:2344:x1869117108810624:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529234.345124:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529234.345154:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabe9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade07 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.345178:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568000) 00010000:00010000:3.0:1782529234.345183:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529234.345244:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:2344:x1869117108810624:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 147us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529234.345253:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:1.0:1782529234.345880:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108810880 00000100:00100000:1.0:1782529234.345908:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108810880 00000100:00100000:1.0:1782529234.345954:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:1.0:1782529234.345962:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:10288:x1869117108810880:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529234.345991:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529234.346012:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eabeab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade0e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529234.346149:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eabeb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529234.346166:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eabeb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529234.346179:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eabeb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529234.346193:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782529234.346359:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eabeab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade0e expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529234.346379:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eabeb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade0e expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529234.346388:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568000) 00010000:00010000:1.0:1782529234.346391:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782529234.346394:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6400, rc 0) 00000100:00100000:1.0:1782529234.346660:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10288:x1869117108810880:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 697us (1772us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1782529234.346668:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:0.0:1782529234.359208:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529234.359316:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108811008 00000100:00100000:2.0:1782529234.359329:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108811008 00000100:00100000:2.0:1782529234.359411:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1782529234.359424:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108811008:12345-192.168.202.50@tcp:1:lfs.0 00010000:00010000:2.0:1782529234.359498:0:8328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.359526:0:8328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.359535:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782529234.359558:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529234.359564:0:8328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.359610:0:8328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.359627:0:8328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 7 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529234.359646:0:8328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c642b80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8328:1869117117232256:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529234.359767:0:8328:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529234.367201:0:8328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c642b80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8328:1869117117232256:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529234.367210:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00010000:00010000:2.0:1782529234.367246:0:8328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529234.368003:0:6596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108811136 00000100:00100000:3.0:1782529234.368014:0:6596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108811136 00002000:00100000:3.0:1782529234.368064:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff99c67b0c6300 x1869117108811136/t0(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:670/0 lens 504/0 e 0 to 0 dl 1782529245 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529234.368075:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67b0c6300 with x1869117108811136 ext(0->12) 00010000:00010000:3.0:1782529234.368084:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 8 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.368102:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 8 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782529234.368128:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99c67b0c6300 00000100:00100000:3.0:1782529234.368167:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1782529234.368178:0:6596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108811136:12345-192.168.202.50@tcp:4:lfs.0 00010000:00010000:2.0:1782529234.380086:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782529234.451409:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000100:00100000:1.0:1782529234.452348:0:6596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108811136:12345-192.168.202.50@tcp:4:lfs.0 Request processed in 84161us (85157us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782529234.452392:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00002000:00100000:1.0:1782529234.452409:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff99c67b0c6300 x1869117108811136/t4294967299(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:670/0 lens 504/448 e 0 to 0 dl 1782529245 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782529234.452420:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67b0c6300 with x1869117108811136 ext(0->12) 00010000:00010000:1.0:1782529234.452433:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 9 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529234.452473:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 9 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782529234.452482:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99c67b0c6300 00000100:00100000:3.0:1782529234.457094:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529234.457221:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108811264 00000100:00100000:0.0:1782529234.457234:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108811264 00010000:00010000:0.0:1782529234.457301:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 9 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529234.457356:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:0.0:1782529234.457369:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108811264:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529234.457398:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782529234.457425:0:8316:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782529234.457428:0:8316:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782529234 00002000:00010000:0.0:1782529234.457431:0:8316:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782529234 00002000:00010000:0.0:1782529234.457433:0:8316:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782529234 00010000:00010000:0.0:1782529234.457439:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 9 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.457489:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 9 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.457520:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008be29687/0x72bfdc08f7eabe73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addf2 expref: 9 pid: 6592 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.457545:0:8316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782529234.457550:0:8316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782529234.457557:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.457569:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.457613:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529234.457686:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108811264:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 319us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529234.457696:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00010000:00010000:2.0:1782529234.457929:0:8328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.457940:0:8328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.457972:0:8328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.457998:0:8328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.458008:0:8328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.458016:0:8328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529234.458021:0:8328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.458031:0:8328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.458044:0:8328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.458051:0:8328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eabec0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529234.458110:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108811008:12345-192.168.202.50@tcp:1:lfs.0 Request processed in 98689us (98918us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529234.458120:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1782529234.463208:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529234.463399:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108811520 00000100:00100000:2.0:1782529234.463414:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108811520 00000100:00100000:2.0:1782529234.463629:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:2.0:1782529234.463663:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10288:x1869117108811520:12345-192.168.202.50@tcp:35:lfs.0 00000004:00010000:2.0:1782529234.463766:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eabeb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade0e expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529234.464622:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1782529234.464698:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1782529234.466683:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1782529234.466805:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.466830:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.467348:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.467611:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.467632:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 24 pid: 5794 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529234.467653:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c8a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1869117117232384:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529234.467918:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6584c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1782529234.476395:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529234.476574:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108811648 00000100:00100000:3.0:1782529234.476587:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108811648 00010000:00010000:3.0:1782529234.476943:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 25 pid: 5794 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529234.477001:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:3.0:1782529234.477013:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+25:2343:x1869117108811648:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529234.477033:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529234.477041:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 25 pid: 5794 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.477056:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 25 pid: 5794 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.477085:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568000) 00010000:00010000:3.0:1782529234.477091:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.477102:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.477110:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.477152:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529234.477220:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+25:2343:x1869117108811648:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 208us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529234.477229:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00010000:00010000:0.0:1782529234.480574:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabe57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adde4 expref: 24 pid: 5794 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529234.480619:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c8a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1869117117232384:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529234.480657:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.480670:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.480677:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782529234.481089:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1782529234.481764:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1782529234.482707:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c8a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869117117232512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782529234.482978:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529234.483045:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6584c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1782529234.483219:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117232512 00000100:00100000:3.0:1782529234.483229:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117232512 00000100:00100000:3.0:1782529234.483660:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782529234.483672:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1869117117232512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782529234.483789:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1869117117232512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529234.483798:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782529234.483921:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c8a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869117117232512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782529234.484595:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1782529234.484683:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c8a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869117117232640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782529234.484731:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529234.485474:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645143cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529234.485515:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117232640 00000100:00100000:2.0:1782529234.485522:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117232640 00000100:00100000:2.0:1782529234.485561:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529234.485570:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1869117117232640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782529234.485778:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1869117117232640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 209us (1046us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1782529234.485785:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782529234.485923:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c8a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869117117232640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782529234.485988:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1782529234.486029:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.486050:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.486057:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.486063:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529234.486068:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.486076:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.486092:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568000) 00010000:00010000:0.0:1782529234.486095:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782529234.486100:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.486107:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eabec7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782529234.486298:0:5797:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782529234.486713:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1782529234.486726:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 296398891787ns, next at 297398889798ns, rc = 0 00000001:00080000:0.0:1782529234.486733:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1782529234.486770:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568000) 00010000:00010000:0.0:1782529234.486774:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782529234.486781:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eabeb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade0e expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529234.487075:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10288:x1869117108811520:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 23415us (23882us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782529234.487084:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000020:00080000:0.0:1782529234.487090:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782529234.489361:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529234.489432:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108811776 00000100:00100000:0.0:1782529234.489445:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108811776 00000100:00100000:0.0:1782529234.489516:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:0.0:1782529234.489526:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10288:x1869117108811776:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529234.489549:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529234.489572:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabece lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade15 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.489628:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade15 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.489642:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade15 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.489661:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:0.0:1782529234.489665:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529234.489668:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170a00, rc 0) 00000100:00100000:0.0:1782529234.489725:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:10288:x1869117108811776:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 201us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529234.489732:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:2.0:1782529234.495429:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529234.495649:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108812032 00000100:00100000:1.0:1782529234.495659:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108812032 00000100:00100000:1.0:1782529234.495718:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1782529234.495729:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:10288:x1869117108812032:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529234.496009:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:10288:x1869117108812032:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 280us (588us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1782529234.496017:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1782529234.590597:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529234.590911:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108812288 00000100:00100000:3.0:1782529234.590925:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108812288 00000100:00100000:3.0:1782529234.591007:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:3.0:1782529234.591021:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:10298:x1869117108812288:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1782529234.591062:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529234.591093:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade1c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529234.591252:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782529234.591412:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabed5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade1c expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.591429:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:3.0:1782529234.591432:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782529234.591439:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade1c expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.591477:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045000, rc 0) 00000100:00100000:3.0:1782529234.591569:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+30:10298:x1869117108812288:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 551us (988us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1782529234.591578:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:2.0:1782529234.595477:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529234.596018:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108812416 00000100:00100000:0.0:1782529234.596035:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108812416 00000100:00100000:0.0:1782529234.596135:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:0.0:1782529234.596148:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+30:10298:x1869117108812416:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:0.0:1782529234.596223:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596240:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596252:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596281:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596289:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596296:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596531:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596541:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596549:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782529234.596592:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596604:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596617:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596625:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596631:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529234.596635:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596642:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596654:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:0.0:1782529234.596658:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529234.596663:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596670:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eabee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596685:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596691:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596697:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596702:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529234.596710:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596717:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596724:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c642b0f500) 00010000:00010000:0.0:1782529234.596727:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529234.596729:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596735:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eabeea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596768:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596775:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596780:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596784:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529234.596787:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596792:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596799:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:0.0:1782529234.596801:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529234.596809:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529234.596815:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eabef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529234.597728:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+30:10298:x1869117108812416:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 1575us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529234.597739:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1782529234.602275:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529234.602479:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108812672 00000100:00100000:1.0:1782529234.602489:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108812672 00000100:00100000:1.0:1782529234.602559:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1782529234.602569:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+30:10298:x1869117108812672:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529234.602824:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:10298:x1869117108812672:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 255us (572us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1782529234.602874:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1782529234.652280:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529234.653024:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108812928 00000100:00100000:2.0:1782529234.653035:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108812928 00000100:00100000:2.0:1782529234.653108:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:2.0:1782529234.653133:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:10301:x1869117108812928:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529234.653157:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529234.653176:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabef8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade23 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653252:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653267:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653280:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653296:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653304:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653311:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653456:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653465:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653473:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529234.653496:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782529234.653587:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653595:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653602:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653608:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529234.653613:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653620:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653634:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529234.653637:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529234.653641:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653647:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabeff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653661:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653667:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653682:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653687:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529234.653690:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653696:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653705:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568e00) 00010000:00010000:2.0:1782529234.653707:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529234.653710:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653715:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabf06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653758:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eabef8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653771:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529234.653778:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:2.0:1782529234.653780:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529234.653782:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00800, rc 0) 00000100:00100000:2.0:1782529234.654087:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:10301:x1869117108812928:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 955us (1814us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1782529234.654103:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:2.0:1782529234.657280:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529234.657362:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108813056 00000100:00100000:3.0:1782529234.657372:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108813056 00000100:00100000:3.0:1782529234.657426:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1782529234.657436:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:10301:x1869117108813056:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1782529234.657510:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657527:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657540:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657565:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657572:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657579:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657585:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529234.657589:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657609:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657621:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529234.657624:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782529234.657629:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529234.657634:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529234.657706:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:10301:x1869117108813056:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 271us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529234.657713:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1782529234.660158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529234.660242:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108813312 00000100:00100000:1.0:1782529234.660253:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108813312 00000100:00100000:1.0:1782529234.660306:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1782529234.660317:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:10301:x1869117108813312:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529234.660803:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:10301:x1869117108813312:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 486us (652us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1782529234.660812:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1782529235.028389:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529235.028445:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108813568 00000100:00100000:3.0:1782529235.028463:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108813568 00000100:00100000:3.0:1782529235.028539:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:3.0:1782529235.028558:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:10332:x1869117108813568:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:3.0:1782529235.028581:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529235.028607:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade2a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.028704:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.028719:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.028746:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529235.028757:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782529235.028934:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade2a expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.028948:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade2a expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.028954:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529235.028956:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529235.028958:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044600, rc 0) 00000100:00100000:3.0:1782529235.029020:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:10332:x1869117108813568:12345-192.168.202.50@tcp:101:cat.0 Request processed in 455us (630us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1782529235.029026:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00080000:1.0:1782529235.029532:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529235.034243:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529235.034472:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108813696 00000100:00100000:0.0:1782529235.034482:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108813696 00000100:00100000:0.0:1782529235.034549:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:0.0:1782529235.034559:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650284050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:2343:x1869117108813696:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529235.034573:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529235.034597:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade2a expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529235.034624:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:0.0:1782529235.034629:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529235.034689:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650284050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:2343:x1869117108813696:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 132us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529235.034697:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:2.0:1782529235.034977:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529235.038520:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108813952 00000100:00100000:0.0:1782529235.038537:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108813952 00000100:00100000:0.0:1782529235.038597:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:0.0:1782529235.038608:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:10332:x1869117108813952:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:0.0:1782529235.038880:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:10332:x1869117108813952:12345-192.168.202.50@tcp:35:cat.0 Request processed in 273us (3900us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1782529235.038905:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:2.0:1782529235.138077:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529235.138353:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108814208 00000100:00100000:3.0:1782529235.138364:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108814208 00000100:00100000:3.0:1782529235.138433:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1782529235.138449:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:10338:x1869117108814208:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:3.0:1782529235.138477:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529235.138480:0:6616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782529235.138512:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabe8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade00 expref: 36 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.138697:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:3.0:1782529235.138703:0:6616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529235.138734:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade31 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.138896:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.138910:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 36 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.138919:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.138953:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 36 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.138967:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 36 pid: 5794 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529235.138980:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117232768:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529235.139365:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646feff00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529235.143583:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529235.143873:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108814336 00000100:00100000:2.0:1782529235.143883:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108814336 00010000:00010000:2.0:1782529235.143925:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 37 pid: 5794 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529235.143967:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:2.0:1782529235.143977:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:2343:x1869117108814336:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529235.143992:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529235.143999:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 37 pid: 5794 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529235.144022:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 37 pid: 5794 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529235.144044:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:2.0:1782529235.144050:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529235.144060:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529235.144069:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529235.144100:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529235.144155:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:2343:x1869117108814336:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 179us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529235.144164:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00010000:00010000:3.0:1782529235.144915:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eabf0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade23 expref: 36 pid: 5794 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529235.144936:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117232768:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529235.144962:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.144972:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.144992:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529235.145084:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782529235.145266:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 37 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.145282:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 36 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.145290:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529235.145292:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782529235.145295:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045400, rc 0) 00000100:00100000:3.0:1782529235.145346:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:10338:x1869117108814208:12345-192.168.202.50@tcp:101:dd.0 Request processed in 6905us (7279us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1782529235.145354:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:0.0:1782529235.153102:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529235.153241:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108814592 00000100:00100000:3.0:1782529235.153251:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108814592 00000100:00100000:3.0:1782529235.153312:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:3.0:1782529235.153322:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:10338:x1869117108814592:12345-192.168.202.50@tcp:36:dd.0 00010000:00010000:3.0:1782529235.153622:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.153638:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.153649:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782529235.153717:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1782529235.153740:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af953c24 reply state 00000000403a1ba8 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529235.153749:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529235.153880:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:10338:x1869117108814592:12345-192.168.202.50@tcp:36:dd.0 Request processed in 559us (787us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1782529235.153888:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000020:00080000:3.0:1782529235.153893:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782529235.159133:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529235.159153:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529235.159161:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529235.159168:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529235.159173:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529235.159180:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529235.159198:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:0.0:1782529235.159201:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529235.159207:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529235.159213:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.399421:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529235.519954:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529235.523701:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108814720 00000100:00100000:1.0:1782529235.523719:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108814720 00000100:00100000:1.0:1782529235.523803:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:1.0:1782529235.523814:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+38:10352:x1869117108814720:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:1.0:1782529235.523894:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529235.523919:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabf53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade38 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.523985:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524017:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524029:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524043:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524049:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524054:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524148:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524157:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 39 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524165:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524197:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 39 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.524210:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 39 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529235.524233:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117232896:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529235.524353:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6453ff480 going to sleep for 11 seconds 00000100:00100000:2.0:1782529235.528812:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529235.528945:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117232896:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529235.528962:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108814976 00000100:00100000:3.0:1782529235.528975:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108814976 00010000:00010000:1.0:1782529235.528977:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529235.529046:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1782529235.529059:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:5558:x1869117108814976:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782529235.529686:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+41:5558:x1869117108814976:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 626us (887us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1782529235.529696:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:2.0:1782529235.532701:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529235.532885:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108815104 00000100:00100000:3.0:1782529235.532900:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108815104 00010000:00010000:3.0:1782529235.532958:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 41 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529235.533013:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:3.0:1782529235.533024:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+41:2344:x1869117108815104:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529235.533046:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529235.533055:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 41 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.533094:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 41 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.533126:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade31 expref: 41 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.533148:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529235.533154:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.533165:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.533174:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.533210:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529235.533288:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:2344:x1869117108815104:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 265us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529235.533298:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00010000:00010000:1.0:1782529235.533510:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533527:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529235.533584:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782529235.533589:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529235.533634:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533650:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533660:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533667:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533673:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533679:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529235.533696:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533704:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533718:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:1.0:1782529235.533720:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529235.533725:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533731:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabf5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.533747:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534020:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534027:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534032:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529235.534035:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534042:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534051:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c643b34900) 00010000:00010000:1.0:1782529235.534053:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529235.534063:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534070:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabf61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534117:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eabf53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade38 expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534132:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade38 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529235.534140:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:1.0:1782529235.534142:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782529235.534144:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7800, rc 0) 00000100:00100000:1.0:1782529235.534211:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:10352:x1869117108814720:12345-192.168.202.50@tcp:101:stat.0 Request processed in 10397us (14263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529235.534220:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:0.0:1782529235.593284:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529235.593361:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108815360 00000100:00100000:3.0:1782529235.593386:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108815360 00000100:00100000:3.0:1782529235.593736:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:3.0:1782529235.593749:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:10358:x1869117108815360:12345-192.168.202.50@tcp:36:truncate.0 00010000:00010000:3.0:1782529235.593919:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529235.593958:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eabf68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade38 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.593998:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529235.594005:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529235.594321:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.594338:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.594348:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782529235.594426:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1782529235.594473:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c391b217 reply state 00000000449cae9d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529235.596020:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529235.596262:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+41:10358:x1869117108815360:12345-192.168.202.50@tcp:36:truncate.0 Request processed in 2502us (2980us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1782529235.596273:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000020:00080000:3.0:1782529235.596281:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782529235.600345:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.600371:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.600392:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.600401:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529235.600427:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.600437:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.600774:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529235.600778:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529235.600786:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.600795:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529235.849046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529235.849797:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108815488 00000100:00100000:3.0:1782529235.849812:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108815488 00000100:00100000:3.0:1782529235.850053:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:3.0:1782529235.850066:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:10372:x1869117108815488:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:3.0:1782529235.850098:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529235.850124:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade3f expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850293:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850313:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850327:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850346:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850435:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850511:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850649:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850660:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850667:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529235.850717:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1782529235.850723:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782529235.850753:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850767:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850778:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850784:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850791:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850809:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529235.850814:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.850823:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851645:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:3.0:1782529235.851652:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529235.851660:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851667:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabf7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851690:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851698:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851704:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851709:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529235.851712:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851719:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851801:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c6601f9200) 00010000:00010000:3.0:1782529235.851804:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529235.851807:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851814:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabf84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851927:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 42 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851942:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 41 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.851949:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529235.851951:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529235.851954:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045600, rc 0) 00000100:00100000:3.0:1782529235.852047:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+41:10372:x1869117108815488:12345-192.168.202.50@tcp:101:stat.0 Request processed in 1983us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529235.852057:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:2.0:1782529235.955524:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529235.955589:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108815744 00000100:00100000:3.0:1782529235.955680:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108815744 00000100:00100000:3.0:1782529235.955768:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:3.0:1782529235.955781:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+41:10382:x1869117108815744:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1782529235.955811:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529235.955970:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade46 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529235.956157:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782529235.956342:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade46 expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.956359:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:3.0:1782529235.956362:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782529235.958103:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabf92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade46 expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529235.958133:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045400, rc 0) 00000100:00100000:3.0:1782529235.958240:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+42:10382:x1869117108815744:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 2460us (2726us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1782529235.958252:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:2.0:1782529235.964192:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529235.964300:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108816000 00000100:00100000:0.0:1782529235.964314:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108816000 00000100:00100000:0.0:1782529235.964530:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:0.0:1782529235.964544:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+42:10382:x1869117108816000:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1782529235.965511:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:10382:x1869117108816000:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 820us (1180us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1782529235.965525:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529236.039092:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529236.039136:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117233024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529236.039230:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529236.039316:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117233024 00000100:00100000:1.0:1782529236.039325:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117233024 00000100:00100000:1.0:1782529236.039389:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782529236.039400:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117233024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782529236.039459:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529236.039512:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117233024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529236.039521:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1782529236.039567:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529236.039612:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117233024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529236.040717:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.040758:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108816256 00000100:00100000:3.0:1782529236.040767:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108816256 00000100:00100000:3.0:1782529236.040819:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1782529236.040869:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:10388:x1869117108816256:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1782529236.040895:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529236.040922:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabfa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade4d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.041059:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.041078:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 44 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.041100:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.041165:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 44 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.041181:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 44 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.041196:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117233152:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529236.041284:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782529236.045212:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782529236.045245:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117233280:0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.045339:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529236.045718:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117233408:0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.045756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529236.045795:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117233408 00000100:00100000:1.0:1782529236.045804:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117233408 00000100:00100000:1.0:1782529236.045934:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782529236.045945:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117233408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.046010:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117233408:12345-0@lo:400:kworker.0 Request processed in 65us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529236.046017:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782529236.046066:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117233408:0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.046124:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117233536:0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.046151:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529236.046183:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117233536 00000100:00100000:1.0:1782529236.046187:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117233536 00000100:00100000:1.0:1782529236.046219:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1782529236.046225:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529236.046225:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117233536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.046259:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117233536:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529236.046265:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782529236.046283:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117233536:0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.046296:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117233664:0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.046341:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529236.046409:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782529236.046416:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117233792:0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.046446:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529236.046477:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117233792 00000100:00100000:1.0:1782529236.046481:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117233792 00000100:00100000:1.0:1782529236.046517:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782529236.046524:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1869117117233792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529236.046563:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1869117117233792:12345-0@lo:400:kworker.0 Request processed in 39us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529236.046569:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1782529236.046583:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529236.046602:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117233792:0@lo:400:kworker.0 00000100:00100000:0.0:1782529236.046714:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117233280 00000100:00100000:0.0:1782529236.046719:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117233280 00000100:00100000:2.0:1782529236.046756:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117233664 00000100:00100000:0.0:1782529236.046758:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1782529236.046760:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117233664 00000100:00100000:0.0:1782529236.046765:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117233280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529236.046787:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782529236.046794:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117233664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529236.046806:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117233280:12345-0@lo:400:kworker.0 Request processed in 42us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529236.046812:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1782529236.046859:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117233664:12345-0@lo:400:kworker.0 Request processed in 35us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529236.046865:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782529236.046890:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117233280:0@lo:400:kworker.0 00000100:00080000:1.0:1782529236.049652:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529236.049736:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117233664:0@lo:400:kworker.0 00000100:00100000:2.0:1782529236.054162:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529236.054248:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108816384 00000100:00100000:0.0:1782529236.054262:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108816384 00010000:00010000:0.0:1782529236.054322:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 45 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529236.054383:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:0.0:1782529236.054395:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:2344:x1869117108816384:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529236.054413:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529236.054421:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 45 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.054455:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 45 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.054485:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:0.0:1782529236.054491:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.054501:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.054509:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.054533:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529236.054609:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:2344:x1869117108816384:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 216us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529236.054617:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00010000:00010000:3.0:1782529236.056297:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eabf8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade3f expref: 44 pid: 6616 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.056338:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117233152:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529236.056557:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.056571:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.056692:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529236.056723:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1782529236.057133:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eabfa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.057173:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 44 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.057193:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529236.057196:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782529236.057201:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044600, rc 0) 00000100:00100000:3.0:1782529236.057286:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+44:10388:x1869117108816256:12345-192.168.202.50@tcp:101:bash.0 Request processed in 16458us (16577us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1782529236.057295:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1782529236.065266:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.065316:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108816640 00000100:00100000:3.0:1782529236.065330:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108816640 00000100:00100000:3.0:1782529236.065400:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:3.0:1782529236.065412:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+44:10388:x1869117108816640:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:3.0:1782529236.065816:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.065891:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.065906:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782529236.065968:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1782529236.065997:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079fec1f9 reply state 000000008bc1e400 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.066028:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529236.066147:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:10388:x1869117108816640:12345-192.168.202.50@tcp:36:bash.0 Request processed in 737us (894us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1782529236.066156:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00000020:00080000:3.0:1782529236.066162:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782529236.073942:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.073960:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.073966:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.073971:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529236.073985:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.073991:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.074011:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:2.0:1782529236.074013:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529236.074016:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.074020:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eabfb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529236.083763:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.083814:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108816768 00000100:00100000:2.0:1782529236.083865:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108816768 00000100:00100000:2.0:1782529236.083931:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:2.0:1782529236.083941:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+46:10388:x1869117108816768:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529236.083972:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529236.083997:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eabfbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade54 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.084102:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.084120:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.084129:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.084184:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.084200:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 47 pid: 5795 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529236.084217:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c642b81500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117233920:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529236.084319:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67fb64c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529236.092039:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c642b81500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117233920:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529236.092077:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.094334:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.094775:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108816896 00000100:00100000:3.0:1782529236.094788:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108816896 00010000:00010000:3.0:1782529236.094872:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 48 pid: 5795 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.094925:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:3.0:1782529236.094937:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+48:2343:x1869117108816896:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529236.094959:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529236.094968:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 48 pid: 5795 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.094984:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 48 pid: 5795 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095018:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eabfa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade4d expref: 48 pid: 5795 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095060:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529236.095067:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095078:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095088:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095120:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529236.095188:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:2343:x1869117108816896:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 252us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.095196:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00010000:00010000:3.0:1782529236.095342:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095352:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529236.095440:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782529236.095446:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782529236.095477:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095516:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eabfbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade54 expref: 47 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095532:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade54 expref: 46 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.095547:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529236.095550:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529236.095553:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01a00, rc 0) 00000100:00100000:3.0:1782529236.096033:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+46:10388:x1869117108816768:12345-192.168.202.50@tcp:101:bash.0 Request processed in 12090us (12282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.096042:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:3.0:1782529236.099139:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.099194:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108817152 00000100:00100000:3.0:1782529236.099205:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108817152 00000100:00100000:3.0:1782529236.099274:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1782529236.099285:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+46:10388:x1869117108817152:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:3.0:1782529236.100182:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:10388:x1869117108817152:12345-192.168.202.50@tcp:35:bash.0 Request processed in 891us (1050us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1782529236.100194:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000001:00080000:0.0:1782529236.114282:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000004:00080000:0.0:1782529236.114312:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1782529236.114341:0:5816:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99c645294a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1782529236.114346:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6785e0100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99c645294840 00000020:00080000:0.0:1782529236.114350:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6785e0200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99c65008d400 00000100:00100000:1.0:1782529236.115000:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529236.115030:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c642b80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117234048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782529236.115120:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1782529236.115237:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1782529236.116571:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1782529236.117033:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117234048 00000100:00100000:2.0:1782529236.117050:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117234048 00000100:00100000:2.0:1782529236.117140:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782529236.117153:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1869117117234048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782529236.117198:0:6593:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1782529236.117247:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a3f3cd2, atime: 0x6a3f3cd2, ctime: 0x6a3f3cd2, blocks: 0x1 00010000:00010000:2.0:1782529236.117257:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.117276:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=298s v=(0 0) 00010000:00010000:2.0:1782529236.117281:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529236.117290:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.117309:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.117321:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.117347:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.117523:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529236.118475:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529236.118485:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.118498:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529236.118503:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.118524:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.118549:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.118556:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eabfca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.118587:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529236.118589:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529236.118591:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529236.120289:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1869117117234048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3128us (5158us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782529236.120308:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1782529236.120747:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c642b80380/2, rc 0, transno 4294967301 00000100:00100000:1.0:1782529236.120757:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c642b80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117234048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782529236.203817:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529236.204195:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108817408 00000100:00100000:1.0:1782529236.204210:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108817408 00000100:00100000:1.0:1782529236.204295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:1.0:1782529236.204308:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:10398:x1869117108817408:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529236.204343:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529236.204373:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabfd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade5b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529236.204745:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1782529236.205004:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabfd1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade5b expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.205035:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:1.0:1782529236.205038:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782529236.205044:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eabfd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade5b expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.205059:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6e00, rc 0) 00000100:00100000:1.0:1782529236.205147:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:10398:x1869117108817408:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 841us (1384us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1782529236.205155:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:2.0:1782529236.210720:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.211343:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108817536 00000100:00100000:3.0:1782529236.211415:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108817536 00000100:00100000:2.0:1782529236.211809:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:2.0:1782529236.211823:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:10398:x1869117108817536:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1782529236.211959:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.211980:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.211994:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212012:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212020:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212026:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212695:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212709:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212716:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529236.212775:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212790:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212799:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212806:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212814:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529236.212820:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212878:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212893:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529236.212897:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529236.212903:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212917:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eabfdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212933:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212939:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212945:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212949:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529236.212953:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212959:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212966:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568500) 00010000:00010000:2.0:1782529236.212969:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529236.212972:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212978:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eabfe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.212994:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.213000:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.213012:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.213017:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529236.213019:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.213026:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.213034:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:2.0:1782529236.213036:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529236.213039:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.213046:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eabfed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529236.213159:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:10398:x1869117108817536:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 1336us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529236.213170:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:0.0:1782529236.216552:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.216949:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108817792 00000100:00100000:3.0:1782529236.216963:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108817792 00000100:00100000:3.0:1782529236.217030:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:3.0:1782529236.217042:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:10398:x1869117108817792:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1782529236.222076:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:10398:x1869117108817792:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 5016us (5519us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1782529236.222119:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:0.0:1782529236.266237:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529236.266490:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108818048 00000100:00100000:1.0:1782529236.266504:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108818048 00000100:00100000:1.0:1782529236.266642:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:1.0:1782529236.266655:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:10401:x1869117108818048:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529236.266690:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529236.266718:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabff4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade62 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.266903:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.266923:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.266936:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.266952:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.266968:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.266975:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267455:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267467:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267474:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529236.267487:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782529236.267614:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267622:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267629:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267636:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529236.267641:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267650:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267675:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:1.0:1782529236.267678:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529236.267684:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267691:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eabffb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267707:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267713:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267719:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267725:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529236.267728:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267734:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267743:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c643b34900) 00010000:00010000:1.0:1782529236.267745:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529236.267748:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.267754:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.269195:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eabff4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade62 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.269242:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade62 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.269252:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:1.0:1782529236.269255:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782529236.269259:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6e00, rc 0) 00000100:00100000:1.0:1782529236.269374:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10401:x1869117108818048:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 2712us (3144us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1782529236.269386:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:1.0:1782529236.279142:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.279251:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108818176 00000100:00100000:3.0:1782529236.279265:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108818176 00000100:00100000:3.0:1782529236.279346:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:3.0:1782529236.279359:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10401:x1869117108818176:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1782529236.279480:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279503:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279516:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279552:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279560:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279567:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279761:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972be00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529236.279766:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279775:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279792:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529236.279811:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782529236.279818:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.279963:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529236.280338:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10401:x1869117108818176:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 978us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529236.280350:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:0.0:1782529236.282435:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.282552:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108818304 00000100:00100000:2.0:1782529236.282565:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108818304 00000100:00100000:2.0:1782529236.282651:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1782529236.282662:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:2343:x1869117108818304:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529236.282681:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529236.282712:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac009 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade62 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.282755:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:2.0:1782529236.282761:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529236.282868:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:2343:x1869117108818304:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 207us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529236.282876:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1782529236.286171:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529236.286330:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108818560 00000100:00100000:0.0:1782529236.286343:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108818560 00000100:00100000:0.0:1782529236.286418:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:0.0:1782529236.286431:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:10401:x1869117108818560:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1782529236.286784:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10401:x1869117108818560:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 354us (626us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1782529236.286794:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00010000:00010000:1.0:1782529236.423144:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529236.434457:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.434581:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108818816 00000100:00100000:3.0:1782529236.434595:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108818816 00000100:00100000:3.0:1782529236.434684:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:3.0:1782529236.434697:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10419:x1869117108818816:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:3.0:1782529236.434733:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529236.434762:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac01e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade69 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.435042:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac025 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.435061:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.435074:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529236.435088:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782529236.435260:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac01e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade69 expref: 22 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.435283:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade69 expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.435315:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529236.435318:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782529236.435322:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972ac00, rc 0) 00000100:00100000:3.0:1782529236.435396:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10419:x1869117108818816:12345-192.168.202.50@tcp:101:cat.0 Request processed in 701us (963us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1782529236.435404:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:1.0:1782529236.462548:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529236.463000:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108818944 00000100:00100000:0.0:1782529236.463014:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108818944 00000100:00100000:0.0:1782529236.463096:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:0.0:1782529236.463107:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10420:x1869117108818944:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529236.463141:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529236.463168:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade70 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.463262:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac03a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.463280:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.463293:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529236.463589:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782529236.463594:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529236.464064:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.464121:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade70 expref: 23 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.464146:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac03a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade70 expref: 22 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.464156:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:0.0:1782529236.464159:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782529236.464164:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170000, rc 0) 00000100:00100000:0.0:1782529236.464261:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10420:x1869117108818944:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1153us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529236.464270:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:0.0:1782529236.473171:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.473378:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108819328 00000100:00100000:3.0:1782529236.473391:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108819328 00000100:00100000:3.0:1782529236.473513:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:3.0:1782529236.473528:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10420:x1869117108819328:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1782529236.474031:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10420:x1869117108819328:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 504us (874us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1782529236.474041:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:1.0:1782529236.477578:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.477733:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108819456 00000100:00100000:3.0:1782529236.477747:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108819456 00000100:00100000:3.0:1782529236.477879:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1782529236.477890:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f871c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10420:x1869117108819456:12345-192.168.202.50@tcp:103:lfs.0 00010000:00010000:3.0:1782529236.477911:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782529236.477944:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eabfc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade54 expref: 23 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.477970:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade69 expref: 22 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.477986:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eabece lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade15 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.478008:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c642b0f800) 00010000:00010000:3.0:1782529236.478026:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529236.479000:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f871c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10420:x1869117108819456:12345-192.168.202.50@tcp:103:lfs.0 Request processed in 1104us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.479014:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:1.0:1782529236.481931:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.482104:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108819584 00000100:00100000:3.0:1782529236.482119:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108819584 00000100:00100000:3.0:1782529236.482198:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:3.0:1782529236.482210:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10420:x1869117108819584:12345-192.168.202.50@tcp:58:lfs.0 00010000:00010000:2.0:1782529236.482879:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.482903:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.482917:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782529236.486037:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782529236.486265:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1782529236.486346:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1782529236.487173:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10420:x1869117108819584:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 4953us (5245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529236.487189:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:0.0:1782529236.508456:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.508560:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108819712 00000100:00100000:3.0:1782529236.508582:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108819712 00000100:00100000:3.0:1782529236.508681:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:3.0:1782529236.508694:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10422:x1869117108819712:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1782529236.508725:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529236.508753:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade77 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.508899:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.508919:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.508934:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.508954:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.508986:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.508993:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509360:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509371:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509379:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529236.509429:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782529236.509434:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782529236.509459:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509472:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509482:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509489:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509498:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509516:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972be00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529236.509522:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509530:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509546:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:3.0:1782529236.509549:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529236.509555:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509562:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac04f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509579:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509584:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509591:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509595:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529236.509598:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509605:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509624:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c6601f9100) 00010000:00010000:3.0:1782529236.509627:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529236.509630:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509636:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509680:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 22 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509697:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.509705:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:3.0:1782529236.509708:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782529236.509711:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972bc00, rc 0) 00000100:00100000:3.0:1782529236.509792:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10422:x1869117108819712:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1101us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.509803:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000040:00080000:2.0:1782529236.551160:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529236.551172:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529236.551248:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782529236.551258:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782529236.551585:0:11551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c642b82680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117234176:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782529236.551933:0:11551:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67fb64c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782529236.558924:0:11551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c642b82680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117234176:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782529236.559277:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.559484:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108819840 00000100:00100000:2.0:1782529236.559493:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108819840 00000100:00100000:2.0:1782529236.559568:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:2.0:1782529236.559586:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10429:x1869117108819840:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1782529236.559697:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10429:x1869117108819840:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 Request processed in 112us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529236.559707:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:1.0:1782529236.574572:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.575139:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108819968 00000100:00100000:3.0:1782529236.575153:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108819968 00000100:00100000:3.0:1782529236.575233:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:3.0:1782529236.575244:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10429:x1869117108819968:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782529236.575288:0:5794:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782529236.575449:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10429:x1869117108819968:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 205us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.575465:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:1.0:1782529236.582920:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.582999:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108820096 00000100:00100000:2.0:1782529236.583013:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108820096 00000100:00100000:2.0:1782529236.583089:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:2.0:1782529236.583103:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10429:x1869117108820096:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782529236.583227:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583250:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583263:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583282:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583290:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583302:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583367:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583378:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583385:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529236.583455:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782529236.583460:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529236.583481:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583494:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583502:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583510:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583517:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529236.583522:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583531:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583546:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:2.0:1782529236.583559:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529236.583576:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583584:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac064 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583602:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583608:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583614:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583620:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529236.583624:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583630:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583639:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff99c669568800) 00010000:00010000:2.0:1782529236.583641:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529236.583644:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583649:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac06b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583667:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583680:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583686:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583691:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529236.583695:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583701:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583710:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529236.583713:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529236.583716:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.583721:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac072 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529236.583877:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10429:x1869117108820096:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 723us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529236.583887:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:1.0:1782529236.588237:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.588505:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108820352 00000100:00100000:3.0:1782529236.588520:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108820352 00000100:00100000:3.0:1782529236.588972:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:3.0:1782529236.588990:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10429:x1869117108820352:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529236.589021:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529236.589052:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac079 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade7e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589212:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589229:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589245:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529236.589260:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782529236.589392:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589401:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589409:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589415:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529236.589420:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589461:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589476:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:3.0:1782529236.589480:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782529236.589486:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589492:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589554:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac079 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade7e expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589565:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:3.0:1782529236.589576:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782529236.589581:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac079 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade7e expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.589593:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972ac00, rc 0) 00000100:00100000:3.0:1782529236.589678:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10429:x1869117108820352:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 694us (1457us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1782529236.589688:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:1.0:1782529236.601045:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529236.601549:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108820480 00000100:00100000:0.0:1782529236.601564:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108820480 00000100:00100000:0.0:1782529236.601901:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:0.0:1782529236.601912:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10429:x1869117108820480:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782529236.601963:0:6616:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782529236.602112:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10429:x1869117108820480:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 201us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529236.602121:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:1.0:1782529236.608145:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.616813:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108820736 00000100:00100000:2.0:1782529236.616854:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108820736 00000100:00100000:2.0:1782529236.616939:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:2.0:1782529236.616950:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10429:x1869117108820736:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782529236.616978:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529236.616998:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782529236.617033:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac03a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade70 expref: 22 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.617057:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529236.617062:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529236.617078:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac08e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade85 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782529236.622301:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1782529236.623242:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.623266:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.623281:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.624640:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac08e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade85 expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.624676:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade85 expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.624688:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c669568800) 00010000:00010000:2.0:1782529236.624691:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529236.624696:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00400, rc 0) 00000100:00100000:2.0:1782529236.624809:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10429:x1869117108820736:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 7858us (16677us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1782529236.624871:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:1.0:1782529236.629779:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.629905:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108820992 00000100:00100000:3.0:1782529236.629919:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108820992 00000100:00100000:3.0:1782529236.629998:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:3.0:1782529236.630010:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10429:x1869117108820992:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782529236.630112:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529236.630150:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade85 expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630174:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c669568800) 00010000:00010000:3.0:1782529236.630187:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529236.630220:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630236:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630247:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630264:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630273:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630281:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630644:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630653:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630661:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630675:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ac00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529236.630680:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630689:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630699:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:3.0:1782529236.630702:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529236.630707:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630713:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac0a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630727:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630734:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630740:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630745:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529236.630748:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630755:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630774:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa82934da (ffff99c6601f9100) 00010000:00010000:3.0:1782529236.630776:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529236.630779:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.630786:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac0aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa82934da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.630943:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10429:x1869117108820992:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 934us (1177us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782529236.630952:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:0.0:1782529236.635956:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.637769:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108821120 00000100:00100000:2.0:1782529236.637789:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108821120 00000100:00100000:1.0:1782529236.638084:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:1.0:1782529236.638096:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10429:x1869117108821120:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782529236.638131:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529236.638161:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac0b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade8c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.638208:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.638225:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.638238:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.638361:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac0b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.638397:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.638407:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:1.0:1782529236.638410:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782529236.638414:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6600, rc 0) 00000100:00100000:1.0:1782529236.638548:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10429:x1869117108821120:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 454us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529236.638558:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:1.0:1782529236.652030:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.652161:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108821376 00000100:00100000:2.0:1782529236.652174:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108821376 00000100:00100000:2.0:1782529236.652256:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:2.0:1782529236.652268:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10429:x1869117108821376:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782529236.652420:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.652442:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.652457:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782529236.653029:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1782529236.653044:0:6616:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298565209436ns, next at 299565206216ns, rc = 0 00000004:00010000:3.0:1782529236.653166:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097e9f34b reply state 000000002d923a07 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.653178:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529236.653319:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+25:10429:x1869117108821376:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 1051us (1303us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1782529236.653329:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 75 00010000:00010000:1.0:1782529236.657013:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.657057:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.657064:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.657071:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529236.657077:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.657086:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.657108:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:1.0:1782529236.657111:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782529236.657116:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529236.657122:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac0bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529236.657989:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.658097:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108821504 00000100:00100000:2.0:1782529236.658110:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108821504 00000100:00100000:2.0:1782529236.658182:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:2.0:1782529236.658193:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:10429:x1869117108821504:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782529236.658224:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529236.658249:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade93 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.658328:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.658345:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.658384:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:2.0:1782529236.658388:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782529236.658392:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529236.658466:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+25:10429:x1869117108821504:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 274us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529236.658474:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:1.0:1782529236.662344:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.664698:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108821632 00000100:00100000:3.0:1782529236.664719:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108821632 00000100:00100000:3.0:1782529236.664876:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:3.0:1782529236.664887:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1869117108821632:12345-192.168.202.50@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1782529236.664929:0:6591:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:3.0:1782529236.664970:0:6591:0:(genops.c:1406:class_connect()) connect: client 089f7aa7-7be0-48a9-8829-cfc80cd2ee18, cookie 0x72bfdc08f7eac0cd 00002000:00100000:3.0:1782529236.664986:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 089f7aa7-7be0-48a9-8829-cfc80cd2ee18/ffff99c6500a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782529236.665007:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782529236.665317:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782529236.665365:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c649ef2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782529236.665479:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2340:x1869117108821632:12345-192.168.202.50@tcp:8:lhsmtool_posix.0 Request processed in 593us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.665488:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:3.0:1782529236.674484:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.674617:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108821760 00000100:00100000:2.0:1782529236.674633:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108821760 00000100:00100000:2.0:1782529236.674735:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:2.0:1782529236.674747:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:0:x1869117108821760:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1782529236.675235:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782529236.732599:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1782529236.732640:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000100:00100000:2.0:1782529236.733187:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:0:x1869117108821760:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 58431us (58706us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782529236.733202:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:1.0:1782529236.738770:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.739944:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108822016 00000100:00100000:3.0:1782529236.739963:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108822016 00000100:00100000:3.0:1782529236.740049:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:3.0:1782529236.740063:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+25:10429:x1869117108822016:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782529236.740426:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:10429:x1869117108822016:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 365us (1671us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1782529236.740435:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:1.0:1782529236.742749:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.743763:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108822272 00000100:00100000:3.0:1782529236.743781:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108822272 00000100:00100000:3.0:1782529236.743886:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:3.0:1782529236.743898:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:10429:x1869117108822272:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782529236.744049:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:10429:x1869117108822272:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 152us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.744058:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:3.0:1782529236.751960:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529236.752160:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108822400 00000100:00100000:0.0:1782529236.752180:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108822400 00000100:00100000:0.0:1782529236.752263:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:0.0:1782529236.752275:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:10429:x1869117108822400:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529236.752302:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529236.752328:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac0d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ade9a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.752421:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac0db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.752445:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac0db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.752460:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac0db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529236.752509:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529236.752532:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac0db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.752563:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac0d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade9a expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.752685:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac0db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade9a expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529236.752696:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:0.0:1782529236.752700:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782529236.752703:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:0.0:1782529236.752807:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10429:x1869117108822400:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 535us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529236.752868:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:2.0:1782529236.773009:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.773093:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108822528 00000100:00100000:3.0:1782529236.773107:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108822528 00000100:00100000:3.0:1782529236.773180:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:3.0:1782529236.773192:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108822528:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529236.773237:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529236.773270:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adea1 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782529236.773309:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3f3cd4, blocks: 0x1 00010000:00010000:3.0:1782529236.773333:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=298s v=(0 0) 00010000:00010000:3.0:1782529236.773339:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529236.773351:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 6 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.773377:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 6 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.773394:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972b000, rc 0) 00000100:00100000:3.0:1782529236.773467:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108822528:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 275us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.773475:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:2.0:1782529236.784339:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529236.784419:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108822784 00000100:00100000:1.0:1782529236.784431:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108822784 00000100:00100000:1.0:1782529236.784502:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:1.0:1782529236.784515:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10429:x1869117108822784:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782529236.784689:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10429:x1869117108822784:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 175us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529236.784697:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:1.0:1782529236.789253:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.789335:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108822912 00000100:00100000:3.0:1782529236.789348:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108822912 00000100:00100000:3.0:1782529236.789424:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:3.0:1782529236.789436:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:10429:x1869117108822912:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529236.789462:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529236.789488:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adea8 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.789530:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.789560:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529236.789565:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529236.789639:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.789690:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.789707:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 7 pid: 6592 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.789725:0:6593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643965880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1869117117234304:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529236.789894:0:6593:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782529236.803212:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.803249:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108823040 00000100:00100000:2.0:1782529236.803262:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108823040 00010000:00010000:2.0:1782529236.803313:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 8 pid: 6592 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529236.803416:0:6593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643965880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1869117117234304:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529236.803461:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529236.803482:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972ac00, rc 0) 00000100:00100000:3.0:1782529236.803550:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:10429:x1869117108822912:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 14116us (14312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.803560:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:2.0:1782529236.805828:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1782529236.805870:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650286450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108823040:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529236.805897:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529236.805949:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 7 pid: 6592 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.806694:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 7 pid: 6592 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.806729:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac0e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea1 expref: 7 pid: 6592 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.806753:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529236.806758:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529236.806767:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.806778:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529236.806939:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529236.806958:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c642b83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5779:1869117117234432:192.168.202.50@tcp:105: 00000100:00100000:2.0:1782529236.807093:0:5779:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529236.810370:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c642b83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5779:1869117117234432:192.168.202.50@tcp:105: 00010000:00010000:3.0:1782529236.810408:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529236.810519:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650286450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108823040:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 4660us (7320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529236.810533:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:1.0:1782529236.812152:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529236.812249:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108823168 00000100:00100000:3.0:1782529236.812260:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108823168 00002000:00100000:3.0:1782529236.812321:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99c67f870700 x1869117108823168/t0(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:672/0 lens 504/0 e 0 to 0 dl 1782529247 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529236.812333:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67f870700 with x1869117108823168 ext(0->8) 00002000:00010000:3.0:1782529236.812339:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67f870700 00000100:00100000:3.0:1782529236.812384:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1782529236.812395:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108823168:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782529236.815659:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108823168:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 Request processed in 3256us (3506us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782529236.815675:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00002000:00100000:3.0:1782529236.815688:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99c67f870700 x1869117108823168/t4294967302(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:672/0 lens 504/448 e 0 to 0 dl 1782529247 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529236.815700:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67f870700 with x1869117108823168 ext(0->8) 00002000:00010000:3.0:1782529236.815708:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67f870700 00000100:00100000:1.0:1782529236.820637:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529236.820746:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108823296 00000100:00100000:2.0:1782529236.820760:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108823296 00000100:00100000:0.0:1782529236.821242:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:0.0:1782529236.821260:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10429:x1869117108823296:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782529236.954063:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000001:00080000:3.0:1782529236.954090:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:3.0:1782529236.954098:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1782529236.954105:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1782529236.954131:0:5816:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1782529236.954156:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1782529236.954167:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1782529236.954472:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c642b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117234560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782529236.954560:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529236.954813:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117234560 00000100:00100000:2.0:1782529236.954864:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117234560 00000100:00100000:2.0:1782529236.954919:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782529236.954933:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117234560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782529236.955091:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782529236.955095:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782529237 00002000:00010000:2.0:1782529236.955097:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782529236.955099:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782529236 -> 1782529237 00002000:00010000:2.0:1782529236.955101:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782529236.955142:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1869117117234560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (582us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782529236.955148:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1782529236.955396:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c642b81500/2, rc 0, transno 4294967303 00000100:00100000:1.0:1782529236.955404:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c642b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117234560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782529236.958220:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:10429:x1869117108823296:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 136957us (137588us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529236.958234:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:3.0:1782529236.962255:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529236.962352:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108823424 00000100:00100000:0.0:1782529236.962362:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108823424 00000100:00100000:0.0:1782529236.962421:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:0.0:1782529236.962431:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108823424:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1782529236.990639:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108823424:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 28198us (28383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529236.990652:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000001:00080000:0.0:1782529236.990689:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1782529236.990699:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1782529237.002069:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529237.003475:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108823680 00000100:00100000:3.0:1782529237.003487:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108823680 00000100:00100000:3.0:1782529237.003546:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:3.0:1782529237.003553:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:10429:x1869117108823680:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782529237.003599:0:6616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529237.003623:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac0db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade9a expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.003639:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:3.0:1782529237.003645:0:6616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529237.003672:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.003686:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.003696:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782529237.003938:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1782529237.004321:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2180480 reply state 000000000dc960cf transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529237.004329:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529237.005858:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:10429:x1869117108823680:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 2296us (3791us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1782529237.005870:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:0.0:1782529237.022571:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529237.022608:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108823808 00000100:00100000:0.0:1782529237.022617:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108823808 00000100:00100000:0.0:1782529237.022666:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1782529237.022675:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108823808:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782529237.022968:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782529237.022972:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782529237 -> 1782529236 00002000:00010000:0.0:1782529237.022975:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782529234 00002000:00010000:0.0:1782529237.022977:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782529237 -> 1782529236 00002000:00010000:0.0:1782529237.022979:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782529237.023033:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108823808:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 359us (471us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782529237.023055:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00010000:00010000:3.0:1782529237.023186:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.023201:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.023209:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.023215:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972be00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529237.023220:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.023228:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.023245:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:3.0:1782529237.023248:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529237.023253:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.023260:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac0f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529237.028455:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.028527:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108824064 00000100:00100000:1.0:1782529237.028536:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108824064 00000100:00100000:1.0:1782529237.028593:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:1.0:1782529237.028603:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:10429:x1869117108824064:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782529237.028669:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.028686:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.028696:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.028745:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.028773:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 13 pid: 5795 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.028788:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f871180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117234688:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529237.028912:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529237.036631:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f871180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117234688:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529237.036662:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529237.048865:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.049118:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108824192 00000100:00100000:2.0:1782529237.049128:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108824192 00010000:00010000:2.0:1782529237.049165:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 14 pid: 5795 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.049205:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:2.0:1782529237.049215:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:2344:x1869117108824192:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529237.049230:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529237.049236:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 14 pid: 5795 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.049250:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 14 pid: 5795 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.049271:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac0b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade8c expref: 14 pid: 5795 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.049298:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:2.0:1782529237.049304:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.049314:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.049322:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.049385:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529237.049450:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:2344:x1869117108824192:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 235us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529237.049457:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00010000:00010000:1.0:1782529237.051184:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.051197:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.051228:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.051234:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.051240:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.051246:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529237.051249:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.051262:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.051277:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:1.0:1782529237.051280:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782529237.051295:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.051301:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac0f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.051645:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:10429:x1869117108824064:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 Request processed in 23039us (23195us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782529237.051655:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:3.0:1782529237.065354:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.065449:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108824320 00000100:00100000:1.0:1782529237.065458:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108824320 00000100:00100000:1.0:1782529237.065517:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1782529237.065528:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108824320:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782529237.065572:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.065594:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.065604:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529237.065609:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782529237.065614:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.065651:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.065666:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 7 pid: 6593 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.065696:0:6593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f871880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1869117117234816:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529237.065780:0:6593:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529237.078945:0:6593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f871880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1869117117234816:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529237.078975:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.087165:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529237.087249:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108824448 00000100:00100000:0.0:1782529237.087258:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108824448 00010000:00010000:0.0:1782529237.087296:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 8 pid: 6593 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529237.087339:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:0.0:1782529237.087349:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f871880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108824448:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529237.087377:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529237.087399:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 8 pid: 6593 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.087413:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 8 pid: 6593 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.087449:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e283b52/0x72bfdc08f7eac0e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adea8 expref: 8 pid: 6593 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.087466:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782529237.087470:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782529237.087476:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.087497:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.087522:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529237.087574:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f871880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108824448:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 226us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529237.087582:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00010000:00010000:1.0:1782529237.088185:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.088195:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.088221:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.088229:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.088236:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.088243:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529237.088247:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.088264:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.088280:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.088287:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eac0fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.088369:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108824320:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 22831us (23011us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529237.088377:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:0.0:1782529237.100859:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529237.100935:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108824704 00000100:00100000:3.0:1782529237.100945:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108824704 00000100:00100000:3.0:1782529237.101019:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:3.0:1782529237.101029:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:10429:x1869117108824704:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782529237.101111:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.101137:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.101149:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.101352:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.101364:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.101372:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.101405:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.101420:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 13 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529237.101448:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643966d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117234944:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529237.101521:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529237.109892:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.110133:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108824832 00000100:00100000:1.0:1782529237.110142:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108824832 00010000:00010000:1.0:1782529237.110185:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 14 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.110221:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:1.0:1782529237.110230:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:2343:x1869117108824832:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529237.110244:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529237.110251:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 14 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.110264:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 14 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.110299:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:1.0:1782529237.110304:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.110313:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.110319:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.110338:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529237.110397:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:2343:x1869117108824832:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 167us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529237.110405:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00010000:00010000:3.0:1782529237.112805:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac0c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade93 expref: 13 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529237.112859:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643966d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117234944:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529237.112883:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.112899:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.112905:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782529237.113076:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1782529237.113197:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1782529237.113233:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1782529237.113314:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643966d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1869117117235072:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782529237.113383:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529237.113407:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529237.116123:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117235072 00000100:00100000:1.0:1782529237.116136:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117235072 00000100:00100000:1.0:1782529237.116198:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529237.116208:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1869117117235072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782529237.116335:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1869117117235072:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529237.116342:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529237.116388:0:5794:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1782529237.116394:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c642b81500, transno 4294967303 00000100:00100000:1.0:1782529237.116408:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643966d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1869117117235072:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1782529237.117012:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1782529237.117089:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f871180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1869117117235200:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782529237.117137:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529237.117163:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426600 going to sleep for 11 seconds 00000100:00100000:1.0:1782529237.117335:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117235200 00000100:00100000:1.0:1782529237.117340:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117235200 00000100:00100000:1.0:1782529237.117364:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529237.117370:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1869117117235200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782529237.117515:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1869117117235200:12345-0@lo:1000:mdt00_000.0 Request processed in 144us (377us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1782529237.117522:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529237.117556:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f871180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1869117117235200:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1782529237.117586:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117596:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117602:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117608:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529237.117613:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117620:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117635:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c643b34900) 00010000:00010000:1.0:1782529237.117638:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782529237.117642:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117649:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac10c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117694:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117702:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117708:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117713:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529237.117716:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117722:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117730:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:1.0:1782529237.117733:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782529237.117736:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117742:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac041 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117764:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117777:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117787:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117859:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.117873:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 16 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.117885:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67869df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117235328:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529237.117945:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426600 going to sleep for 11 seconds 00000100:00100000:2.0:1782529237.120809:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67869df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117235328:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529237.120865:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.121622:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.121687:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108824960 00000100:00100000:1.0:1782529237.121694:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108824960 00010000:00010000:1.0:1782529237.121729:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 17 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.121768:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:1.0:1782529237.121778:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:2343:x1869117108824960:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529237.121803:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529237.121810:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 17 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.121855:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 17 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.121877:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac05d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ade77 expref: 17 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.121892:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:1.0:1782529237.121906:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.121916:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.121924:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.121948:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529237.121996:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:2343:x1869117108824960:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 219us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529237.122003:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00010000:00010000:2.0:1782529237.122660:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122670:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122684:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122691:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122709:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122715:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.122719:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122727:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122737:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529237.122740:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.122744:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122750:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac113 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122762:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122768:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122773:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122778:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972be00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.122781:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122809:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122827:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529237.122851:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782529237.122855:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.122861:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac105 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.123069:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:10429:x1869117108824704:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 22041us (22235us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1782529237.123079:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 83 00000020:00080000:2.0:1782529237.123083:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782529237.123277:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529237.123282:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529237.123308:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782529237.123319:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782529237.138220:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529237.138370:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108825216 00000100:00100000:3.0:1782529237.138380:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108825216 00000100:00100000:3.0:1782529237.138530:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:3.0:1782529237.138541:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:10429:x1869117108825216:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782529237.139253:0:5797:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782529237.139354:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1782529237.139401:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.139417:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.140696:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.140720:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.140727:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.140734:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529237.140758:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782529237.141590:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:10429:x1869117108825216:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 3045us (3373us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1782529237.141600:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000020:00080000:3.0:1782529237.141606:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782529237.142134:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529237.142143:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.142151:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972bc00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529237.142155:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.142163:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.142179:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99c6601f9600) 00010000:00010000:1.0:1782529237.142182:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782529237.142186:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.142192:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac11a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.142223:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529237.142225:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529237.142226:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782529237.368367:0:11867:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782529237.368376:0:11867:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782529237.368411:0:11867:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1782529237.368418:0:11867:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1782529237.454118:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529237.511947:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.511982:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108825472 00000100:00100000:1.0:1782529237.511991:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108825472 00000100:00100000:1.0:1782529237.512051:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:1.0:1782529237.512061:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:10443:x1869117108825472:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529237.512084:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529237.512104:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adeaf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.512359:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eac128 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.512371:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eac128 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.512379:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eac128 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529237.512387:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1782529237.512510:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeaf expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.512524:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eac128 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeaf expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.512537:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:1.0:1782529237.512540:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782529237.512542:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6200, rc 0) 00000100:00100000:1.0:1782529237.512593:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10443:x1869117108825472:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 533us (652us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1782529237.512600:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:2.0:1782529237.519229:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.519265:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108825600 00000100:00100000:2.0:1782529237.519274:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108825600 00000100:00100000:2.0:1782529237.519321:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:2.0:1782529237.519331:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10443:x1869117108825600:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1782529237.519405:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519424:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519435:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519461:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519468:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519475:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519804:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519824:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519847:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529237.519889:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519902:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519909:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519916:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519922:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.519926:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519939:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519951:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529237.519954:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.519959:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519964:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac136 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519975:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519980:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519985:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519990:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.519993:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.519999:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520006:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568500) 00010000:00010000:2.0:1782529237.520009:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.520012:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520027:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac13d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520041:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520047:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520052:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520056:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.520060:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520065:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520072:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568f00) 00010000:00010000:2.0:1782529237.520074:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.520076:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.520081:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.520164:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10443:x1869117108825600:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 833us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529237.520173:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:1.0:1782529237.558127:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.558166:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108825856 00000100:00100000:2.0:1782529237.558176:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108825856 00000100:00100000:2.0:1782529237.558233:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:2.0:1782529237.558243:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10446:x1869117108825856:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529237.558264:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529237.558283:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac14b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adeb6 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.558525:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.558541:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.558552:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.558563:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.558613:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.558617:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.558999:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559008:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559026:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529237.559036:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782529237.559120:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559127:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559134:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559139:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.559144:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559151:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559161:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529237.559164:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.559168:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559174:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac152 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559184:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559190:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559200:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559205:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.559208:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559213:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559220:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568f00) 00010000:00010000:2.0:1782529237.559222:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.559224:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559230:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559266:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac14b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 22 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559278:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.559286:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529237.559288:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529237.559290:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00a00, rc 0) 00000100:00100000:2.0:1782529237.559658:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10446:x1869117108825856:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1414us (1537us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1782529237.559675:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:1.0:1782529237.578269:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.578513:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108825984 00000100:00100000:2.0:1782529237.578523:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108825984 00000100:00100000:2.0:1782529237.578588:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:2.0:1782529237.578597:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10446:x1869117108825984:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:2.0:1782529237.578669:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.578688:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.578700:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.578746:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.578754:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.578760:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.578767:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.578771:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.578778:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.578790:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529237.579162:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782529237.579168:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.579175:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac16e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.579257:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10446:x1869117108825984:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 659us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529237.579265:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:1.0:1782529237.582228:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529237.582303:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108826240 00000100:00100000:3.0:1782529237.582311:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108826240 00000100:00100000:3.0:1782529237.582367:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:3.0:1782529237.582377:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10446:x1869117108826240:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1782529237.582565:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10446:x1869117108826240:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 190us (343us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1782529237.582571:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1782529237.646933:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529237.647040:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108826496 00000100:00100000:3.0:1782529237.647056:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108826496 00000100:00100000:2.0:1782529237.647266:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:2.0:1782529237.647279:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:9975:x1869117108826496:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529237.647313:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529237.647341:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac175 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adebd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.647498:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.647515:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.647525:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.647569:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.647596:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 23 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.647646:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c642b81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117235456:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529237.647772:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c677270cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529237.662028:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529237.662223:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108826624 00000100:00100000:0.0:1782529237.662236:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108826624 00010000:00010000:0.0:1782529237.662296:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 24 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529237.662337:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:0.0:1782529237.662348:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:2342:x1869117108826624:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529237.662378:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529237.662387:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 24 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.662402:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 24 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.662467:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:0.0:1782529237.662472:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.662483:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.662491:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.662517:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529237.662601:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:2342:x1869117108826624:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 253us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529237.662610:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00010000:00010000:2.0:1782529237.663133:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeb6 expref: 23 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.663157:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c642b81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117235456:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529237.663186:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.663197:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.663203:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529237.663229:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782529237.663451:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac175 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.663468:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.663477:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529237.663480:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782529237.663484:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01400, rc 0) 00000100:00100000:2.0:1782529237.663548:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:9975:x1869117108826496:12345-192.168.202.50@tcp:101:bash.0 Request processed in 16271us (16626us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1782529237.663572:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:3.0:1782529237.670534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.670925:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108826880 00000100:00100000:2.0:1782529237.670939:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108826880 00000100:00100000:2.0:1782529237.671020:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 89 00000100:00100000:2.0:1782529237.671032:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:9975:x1869117108826880:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:2.0:1782529237.671576:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.671728:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.671745:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529237.672198:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1782529237.672244:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017d54dae reply state 0000000043a43bd8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.672255:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1782529237.672326:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1782529237.673178:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:9975:x1869117108826880:12345-192.168.202.50@tcp:36:bash.0 Request processed in 2140us (2651us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1782529237.673192:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 89 00000020:00080000:2.0:1782529237.673200:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1782529237.684317:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.684343:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.684351:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.684359:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529237.684364:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.684373:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.684396:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:1.0:1782529237.684400:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529237.684542:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.684551:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac18a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529237.685090:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.686266:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108827008 00000100:00100000:1.0:1782529237.686282:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108827008 00000100:00100000:1.0:1782529237.686370:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:1.0:1782529237.686382:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:9975:x1869117108827008:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1782529237.686416:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529237.686451:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adec4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.686530:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adec4 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.686549:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adec4 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.686572:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:1.0:1782529237.686575:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782529237.686580:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7a00, rc 0) 00000100:00100000:1.0:1782529237.686683:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:9975:x1869117108827008:12345-192.168.202.50@tcp:101:bash.0 Request processed in 303us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529237.686692:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:0.0:1782529237.695104:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.695584:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108827136 00000100:00100000:2.0:1782529237.695598:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108827136 00000100:00100000:2.0:1782529237.695683:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1782529237.695693:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:9975:x1869117108827136:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529237.695719:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529237.695767:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adecb expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529237.695802:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3f3cd4, atime: 0x6a3f3cd2, ctime: 0x6a3f3cd4, blocks: 0xb 00010000:00010000:2.0:1782529237.695886:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=299s v=(0 0) 00010000:00010000:2.0:1782529237.695892:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529237.695902:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.695923:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.695936:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529237.696013:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:9975:x1869117108827136:12345-192.168.202.50@tcp:101:bash.0 Request processed in 320us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529237.696021:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:0.0:1782529237.699039:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.699155:0:6596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108827264 00000100:00100000:1.0:1782529237.699168:0:6596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108827264 00002000:00010000:1.0:1782529237.699227:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1782529237.699251:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fac1880 with x1869117108827264 ext(0->18446744073709551615) 00002000:00010000:1.0:1782529237.699267:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67fac1880. 00000100:00100000:1.0:1782529237.699311:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:1.0:1782529237.699323:0:6596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108827264:12345-192.168.202.50@tcp:10:bash.0 00002000:00010000:1.0:1782529237.699719:0:6596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1782529237.699723:0:6596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782529236 -> 1782529238 00002000:00010000:1.0:1782529237.699726:0:6596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1782529234 -> 1782529234 00002000:00010000:1.0:1782529237.699728:0:6596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782529236 -> 1782529238 00002000:00010000:1.0:1782529237.699731:0:6596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1782529237.699804:0:6596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108827264:12345-192.168.202.50@tcp:10:bash.0 Request processed in 482us (778us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782529237.699822:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00002000:00010000:1.0:1782529237.699826:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1782529237.699829:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fac1880 with x1869117108827264 ext(0->18446744073709551615) 00002000:00010000:1.0:1782529237.699884:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67fac1880. 00000100:00100000:3.0:1782529237.792046:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529237.794831:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108827392 00000100:00100000:0.0:1782529237.794865:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108827392 00000100:00100000:0.0:1782529237.794973:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:0.0:1782529237.794985:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10460:x1869117108827392:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:0.0:1782529237.795083:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795102:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795112:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795154:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795162:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795170:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795711:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795721:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795727:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782529237.795775:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795785:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795789:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795795:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795799:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529237.795802:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.795824:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796040:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:0.0:1782529237.796044:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529237.796050:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796057:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac19f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796074:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796080:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796087:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796092:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529237.796094:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796101:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796108:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c642b0f700) 00010000:00010000:0.0:1782529237.796110:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529237.796113:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796130:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac1a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796148:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796154:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796160:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796165:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529237.796168:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796174:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796183:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:0.0:1782529237.796185:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529237.796188:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529237.796192:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac1ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529237.797324:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10460:x1869117108827392:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 2330us (5282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529237.797334:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:0.0:1782529237.840795:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.841050:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108827520 00000100:00100000:1.0:1782529237.841064:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108827520 00000100:00100000:1.0:1782529237.841150:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 287 00000100:00100000:1.0:1782529237.841162:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108827520:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529237.841278:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108827520:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 117us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529237.841286:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 287 00000100:00100000:3.0:1782529237.841992:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529237.842187:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.842780:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108827776 00000100:00100000:1.0:1782529237.842791:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108827776 00000100:00100000:1.0:1782529237.842910:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:1.0:1782529237.842922:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108827776:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529237.843015:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108827776:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 95us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529237.843024:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00080000:1.0:1782529237.843050:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529237.843757:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108827648 00000100:00100000:0.0:1782529237.843766:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108827648 00000100:00100000:0.0:1782529237.843866:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:0.0:1782529237.843876:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108827648:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529237.843929:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108827648:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 55us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529237.843936:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00080000:1.0:1782529237.845747:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529237.847092:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.847206:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108828032 00000100:00100000:2.0:1782529237.847506:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108828032 00000100:00100000:2.0:1782529237.847650:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:2.0:1782529237.847661:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:10463:x1869117108828032:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529237.847688:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529237.847716:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac1b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0aded2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.847822:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.847906:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.847919:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.847938:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.847945:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.847953:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848387:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac1c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848399:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848407:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529237.848420:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782529237.848548:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848557:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848565:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848579:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.848583:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848591:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848607:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529237.848610:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.848615:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848622:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848637:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848643:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848649:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848653:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.848656:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848662:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848680:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568400) 00010000:00010000:2.0:1782529237.848682:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.848685:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.848691:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.849417:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac1b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0aded2 expref: 30 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.849496:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0aded2 expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.849506:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529237.849509:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782529237.849512:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00400, rc 0) 00000100:00100000:2.0:1782529237.849795:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:10463:x1869117108828032:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 2134us (2712us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1782529237.849807:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:2.0:1782529237.863412:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.863739:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108828160 00000100:00100000:1.0:1782529237.863752:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108828160 00000100:00100000:1.0:1782529237.863916:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 93 00000100:00100000:1.0:1782529237.863929:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:10463:x1869117108828160:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1782529237.864023:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.864043:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.864054:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.864101:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.864187:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 29 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.864206:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67869dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117235584:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529237.864504:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782529237.867929:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67869dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117235584:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529237.867970:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529237.868363:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.869704:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108828416 00000100:00100000:2.0:1782529237.869718:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108828416 00000100:00100000:2.0:1782529237.869904:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1782529237.869917:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+30:5558:x1869117108828416:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782529237.870405:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:5558:x1869117108828416:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 488us (2042us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1782529237.870414:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:3.0:1782529237.872993:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529237.873454:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108828544 00000100:00100000:1.0:1782529237.873467:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108828544 00010000:00010000:1.0:1782529237.873542:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 31 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529237.873736:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:1.0:1782529237.873749:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:2343:x1869117108828544:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529237.873769:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529237.873778:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 31 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.873793:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 31 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.873870:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac17c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adebd expref: 31 pid: 5796 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.873894:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:1.0:1782529237.873900:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.873912:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.873923:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529237.873959:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529237.874035:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+30:2343:x1869117108828544:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 287us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529237.874044:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00010000:00010000:2.0:1782529237.874362:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.874374:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.874416:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.874425:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.874432:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.874439:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.874444:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.874453:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.874464:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529237.874467:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782529237.874471:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.874491:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac1d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529237.874556:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:10463:x1869117108828160:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 10630us (11220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529237.874566:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 93 00000100:00100000:3.0:1782529237.877799:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.878218:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108828800 00000100:00100000:2.0:1782529237.878296:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108828800 00000100:00100000:2.0:1782529237.878486:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1782529237.878500:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:10463:x1869117108828800:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1782529237.879038:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+30:10463:x1869117108828800:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 540us (1250us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1782529237.879049:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1782529237.990298:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529237.990483:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108829056 00000100:00100000:2.0:1782529237.990497:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108829056 00000100:00100000:2.0:1782529237.990578:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00100000:2.0:1782529237.990589:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+30:10474:x1869117108829056:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:2.0:1782529237.990622:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529237.990649:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac1de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0aded9 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.990748:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.990766:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.990802:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.990879:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.990888:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.990895:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991310:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac1f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991321:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991328:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529237.991340:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1782529237.991458:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991466:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991473:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991479:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.991491:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991500:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991517:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529237.991520:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.991525:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991532:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac1e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991548:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991555:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991560:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991566:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529237.991569:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991575:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991583:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568400) 00010000:00010000:2.0:1782529237.991585:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529237.991595:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991602:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac1ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991666:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac1de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0aded9 expref: 33 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991682:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0aded9 expref: 32 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529237.991690:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529237.991692:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529237.991695:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01800, rc 0) 00000100:00100000:2.0:1782529237.991779:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:10474:x1869117108829056:12345-192.168.202.50@tcp:101:cat.0 Request processed in 1191us (1497us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1782529237.991789:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00100000:0.0:1782529237.999962:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.000076:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108829312 00000100:00100000:3.0:1782529238.000090:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108829312 00000100:00100000:3.0:1782529238.000162:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:3.0:1782529238.000173:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:10474:x1869117108829312:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:3.0:1782529238.001206:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:10474:x1869117108829312:12345-192.168.202.50@tcp:35:cat.0 Request processed in 1024us (1248us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1782529238.001218:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1782529238.035309:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529238.035806:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108829568 00000100:00100000:2.0:1782529238.035861:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108829568 00000100:00100000:2.0:1782529238.035951:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:2.0:1782529238.035963:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:10475:x1869117108829568:12345-192.168.202.50@tcp:36:rm.0 00010000:00010000:2.0:1782529238.036040:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782529238.036074:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac1f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0aded9 expref: 33 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.036097:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac1c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0aded2 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.036135:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adec4 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.036146:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568500) 00010000:00010000:2.0:1782529238.036159:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529238.036185:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.036200:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.036211:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.036235:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.036242:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.036249:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.037004:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.037016:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.037025:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782529238.038576:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1782529238.038736:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299950902274ns, next at 300950897934ns, rc = 0 00010000:00010000:2.0:1782529238.039179:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.039198:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.039211:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.039219:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.039307:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.039312:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.039536:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782529238.039569:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.039576:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040046:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040055:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529238.040078:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040088:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040107:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568100) 00010000:00010000:2.0:1782529238.040110:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782529238.040116:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040122:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac20f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040150:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040157:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040163:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040168:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529238.040171:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040177:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040185:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529238.040188:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529238.040197:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.040203:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac201 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529238.040214:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014c7d31e reply state 000000007c828407 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529238.040238:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529238.041636:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:10475:x1869117108829568:12345-192.168.202.50@tcp:36:rm.0 Request processed in 5661us (6328us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1782529238.041651:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 95 00010000:00010000:1.0:1782529238.042000:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529238.042010:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.042020:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529238.042025:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.042034:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.042053:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99c669568100) 00010000:00010000:1.0:1782529238.042056:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782529238.042062:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.042067:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac216 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.042091:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529238.042093:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529238.042095:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529238.053651:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.053676:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.053684:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.053692:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529238.053698:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.053707:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.053729:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568400) 00010000:00010000:3.0:1782529238.053750:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529238.053756:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.053764:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac208 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.137984:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529238.138126:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108829824 00000100:00100000:2.0:1782529238.138139:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108829824 00000100:00100000:2.0:1782529238.138273:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:2.0:1782529238.138284:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:10481:x1869117108829824:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529238.138315:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529238.138340:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac21d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adee0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.138520:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.138537:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.138552:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.138567:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.138591:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.138605:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782529238.139235:0:6616:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1782529238.139420:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139431:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139439:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139474:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139482:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139489:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139495:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529238.139499:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139507:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139530:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529238.139533:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529238.139538:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139545:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac224 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529238.139558:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000021cb1ee reply state 00000000f666de6e transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529238.139568:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782529238.139599:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac21d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 34 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139612:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 33 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.139620:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c669568100) 00010000:00010000:2.0:1782529238.139622:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529238.139624:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01800, rc 0) 00000100:00100000:2.0:1782529238.139710:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:10481:x1869117108829824:12345-192.168.202.50@tcp:101:bash.0 Request processed in 1428us (1740us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1782529238.139718:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 96 00000040:00080000:2.0:1782529238.165664:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529238.165675:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529238.165703:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782529238.165709:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782529238.166030:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00010000:00010000:1.0:1782529238.166129:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.166143:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.166152:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.166161:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529238.166166:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.166184:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.166206:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568500) 00010000:00010000:1.0:1782529238.166210:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529238.166216:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.166224:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac22b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529238.167631:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108829952 00000100:00100000:2.0:1782529238.167650:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108829952 00000100:00100000:2.0:1782529238.167729:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:2.0:1782529238.167740:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2342:x1869117108829952:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529238.167760:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529238.167779:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adee7 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529238.167807:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782529238.167879:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1782529238.167885:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529238.167895:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.167915:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.167937:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00a00, rc 0) 00000100:00100000:2.0:1782529238.168006:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2342:x1869117108829952:12345-192.168.202.50@tcp:101:bash.0 Request processed in 268us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529238.168014:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:0.0:1782529238.183401:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.183552:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108830080 00000100:00100000:3.0:1782529238.183567:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108830080 00000100:00100000:3.0:1782529238.183641:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:3.0:1782529238.183652:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:10481:x1869117108830080:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1782529238.183678:0:8328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529238.183704:0:8328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adeee expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.183746:0:8328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.183756:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529238.183761:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529238.183766:0:8328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 9 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.183824:0:8328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.183874:0:8328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 9 pid: 6592 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529238.183910:0:8328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8328:1869117117235712:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529238.184017:0:8328:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b300 going to sleep for 11 seconds 00000100:00100000:3.0:1782529238.192106:0:8328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8328:1869117117235712:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529238.192159:0:8328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 9 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.192189:0:8328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972be00, rc 0) 00000100:00100000:3.0:1782529238.192272:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:10481:x1869117108830080:12345-192.168.202.50@tcp:101:bash.0 Request processed in 8620us (8885us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529238.192281:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:1.0:1782529238.193752:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.193996:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108830208 00000100:00100000:0.0:1782529238.194008:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108830208 00010000:00010000:0.0:1782529238.194059:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 9 pid: 6592 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.194147:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:0.0:1782529238.194158:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650284450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108830208:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529238.194177:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529238.194203:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 9 pid: 6592 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.194219:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 9 pid: 6592 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.194270:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9bfd4f6/0x72bfdc08f7eac240 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee7 expref: 9 pid: 6592 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.194291:0:8316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529238.194296:0:8316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529238.194306:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 8 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.194317:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 8 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.194365:0:8316:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 8 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.194383:0:8316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fac3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8316:1869117117235840:192.168.202.50@tcp:105: 00000100:00100000:0.0:1782529238.194492:0:8316:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64837e780 going to sleep for 11 seconds 00000100:00100000:1.0:1782529238.206072:0:8316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fac3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8316:1869117117235840:192.168.202.50@tcp:105: 00000100:00100000:0.0:1782529238.206072:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00010000:00010000:1.0:1782529238.206108:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529238.206194:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650284450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108830208:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 12036us (12449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529238.206207:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:2.0:1782529238.206520:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108830464 00000100:00100000:2.0:1782529238.206529:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108830464 00000100:00100000:2.0:1782529238.206598:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:2.0:1782529238.206609:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:10481:x1869117108830464:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:2.0:1782529238.210740:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:10481:x1869117108830464:12345-192.168.202.50@tcp:35:bash.0 Request processed in 4114us (4658us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1782529238.210776:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:0.0:1782529238.345171:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529238.345466:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108830592 00000100:00100000:1.0:1782529238.345480:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108830592 00000100:00100000:1.0:1782529238.345560:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 97 00000100:00100000:1.0:1782529238.345571:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:10497:x1869117108830592:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529238.345618:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529238.345649:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac24e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adef5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.345737:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.345770:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.345783:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529238.345911:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1782529238.345916:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529238.345945:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.345977:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac24e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adef5 expref: 36 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.345998:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adef5 expref: 35 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.346007:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:1.0:1782529238.346010:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782529238.346013:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7c00, rc 0) 00000100:00100000:1.0:1782529238.346092:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:10497:x1869117108830592:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 522us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529238.346100:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 97 00000100:00100000:1.0:1782529238.354024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.354115:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108830848 00000100:00100000:3.0:1782529238.354128:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108830848 00000100:00100000:3.0:1782529238.354262:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 98 00000100:00100000:3.0:1782529238.354274:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:10497:x1869117108830848:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1782529238.354300:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529238.354326:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac25c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adefc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.354448:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.354464:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.354478:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529238.354511:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782529238.354818:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac25c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adefc expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.354881:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adefc expref: 37 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.354892:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c669568100) 00010000:00010000:3.0:1782529238.354895:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529238.354898:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972ac00, rc 0) 00000100:00100000:3.0:1782529238.354976:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:10497:x1869117108830848:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 703us (964us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1782529238.354985:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 98 00000100:00100000:3.0:1782529238.359032:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529238.359168:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108831232 00000100:00100000:1.0:1782529238.359180:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108831232 00000100:00100000:1.0:1782529238.359311:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:1.0:1782529238.359324:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:10497:x1869117108831232:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529238.359375:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529238.359405:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac271 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf03 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.359537:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac278 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.359554:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.359567:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529238.359583:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782529238.359757:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac271 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf03 expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.359780:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf03 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.359789:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c669568100) 00010000:00010000:1.0:1782529238.359792:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782529238.359795:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6600, rc 0) 00000100:00100000:1.0:1782529238.360144:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:10497:x1869117108831232:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 820us (1124us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1782529238.360153:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:0.0:1782529238.361188:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.361262:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108830976 00000100:00100000:3.0:1782529238.361272:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108830976 00000100:00100000:3.0:1782529238.361342:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:3.0:1782529238.361364:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:2342:x1869117108830976:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529238.361383:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529238.361409:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adefc expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.361440:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c669568100) 00010000:00010000:3.0:1782529238.361444:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529238.361503:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+38:2342:x1869117108830976:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 152us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529238.361530:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:0.0:1782529238.365740:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529238.366247:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108831360 00000100:00100000:2.0:1782529238.366261:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108831360 00000100:00100000:2.0:1782529238.366338:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:2.0:1782529238.366360:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108831360:12345-192.168.202.50@tcp:1:lfs.0 00010000:00010000:2.0:1782529238.366426:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.366457:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 8 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.366467:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529238.366472:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529238.366477:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.366522:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 8 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.366540:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 8 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529238.366559:0:6592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c642b80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1869117117235968:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529238.366683:0:6592:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529238.369779:0:6592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c642b80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1869117117235968:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529238.369862:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.371503:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.371601:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108831488 00000100:00100000:3.0:1782529238.371612:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108831488 00002000:00100000:3.0:1782529238.371683:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99c67fac2a00 x1869117108831488/t0(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:674/0 lens 504/0 e 0 to 0 dl 1782529249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529238.371695:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fac2a00 with x1869117108831488 ext(0->8) 00010000:00010000:3.0:1782529238.371707:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 9 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.371726:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 9 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782529238.371735:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99c67fac2a00 00000100:00100000:3.0:1782529238.371775:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:3.0:1782529238.371786:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108831488:12345-192.168.202.50@tcp:4:lfs.0 00000100:00100000:3.0:1782529238.372477:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:2343:x1869117108831488:12345-192.168.202.50@tcp:4:lfs.0 Request processed in 687us (979us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782529238.372488:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00002000:00100000:3.0:1782529238.372497:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99c67fac2a00 x1869117108831488/t4294967302(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:674/0 lens 504/448 e 0 to 0 dl 1782529249 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529238.372507:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fac2a00 with x1869117108831488 ext(0->8) 00010000:00010000:3.0:1782529238.372515:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 11 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.372543:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 11 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782529238.372550:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99c67fac2a00 00000100:00100000:2.0:1782529238.375755:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.376127:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108831616 00000100:00100000:3.0:1782529238.376140:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108831616 00010000:00010000:3.0:1782529238.376197:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 11 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529238.376284:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:3.0:1782529238.376296:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:2341:x1869117108831616:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529238.376316:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782529238.376341:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782529238.376344:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782529238 00002000:00010000:3.0:1782529238.376347:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782529238 00002000:00010000:3.0:1782529238.376349:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782529238 00010000:00010000:3.0:1782529238.376355:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 11 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.376370:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 11 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.376399:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d330cf5/0x72bfdc08f7eac247 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeee expref: 11 pid: 8328 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.376437:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529238.376442:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529238.376448:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.376460:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.376499:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529238.376578:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2341:x1869117108831616:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 283us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529238.376587:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00010000:00010000:0.0:1782529238.376658:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.376670:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.376704:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.376717:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.376725:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.376734:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529238.376739:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.376749:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.376762:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.376784:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000531b1b99/0x72bfdc08f7eac286 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.376890:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108831360:12345-192.168.202.50@tcp:1:lfs.0 Request processed in 10543us (11165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529238.376900:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:2.0:1782529238.379885:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.379982:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108831872 00000100:00100000:0.0:1782529238.379995:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108831872 00000100:00100000:0.0:1782529238.380070:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:0.0:1782529238.380081:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+38:10497:x1869117108831872:12345-192.168.202.50@tcp:35:lfs.0 00000004:00010000:0.0:1782529238.380164:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf03 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782529238.380579:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1782529238.380629:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1782529238.381726:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1782529238.382384:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.382414:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 42 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.382434:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.382488:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 42 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.382532:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 42 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.382552:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1869117117236096:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529238.382676:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782529238.389257:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.389428:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108832000 00000100:00100000:3.0:1782529238.389440:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108832000 00010000:00010000:3.0:1782529238.389493:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 43 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529238.389545:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1782529238.389556:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:2344:x1869117108832000:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529238.389575:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529238.389583:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 43 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.389598:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 43 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.389639:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c669568100) 00010000:00010000:3.0:1782529238.389645:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.389657:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.389665:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.389688:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529238.389799:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:2344:x1869117108832000:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 244us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529238.389818:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00010000:00010000:0.0:1782529238.390065:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adee0 expref: 42 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.390086:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1869117117236096:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529238.390114:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.390126:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.390133:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782529238.390384:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1782529238.390703:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1782529238.391586:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117236224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782529238.391662:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529238.391753:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529238.391803:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117236224 00000100:00100000:1.0:1782529238.391822:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117236224 00000100:00100000:0.0:1782529238.392188:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782529238.392198:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1869117117236224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782529238.392317:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1869117117236224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529238.392344:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782529238.392581:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117236224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782529238.393256:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1782529238.393373:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f198e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117236352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782529238.393717:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529238.393786:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7780 going to sleep for 11 seconds 00000100:00080000:1.0:1782529238.393894:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529238.394141:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117236352 00000100:00100000:0.0:1782529238.394150:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117236352 00000100:00100000:0.0:1782529238.394243:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782529238.394255:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1869117117236352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782529238.394533:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5798:x1869117117236352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 280us (815us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1782529238.394542:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782529238.394731:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f198e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117236352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782529238.394854:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1782529238.394914:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.394926:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.394935:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.394942:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529238.394947:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.394956:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.394978:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c669568100) 00010000:00010000:1.0:1782529238.394981:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782529238.394985:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.394992:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac28d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782529238.395220:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782529238.395348:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1782529238.395362:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 300307527873ns, next at 301307525273ns, rc = 0 00000001:00080000:1.0:1782529238.395370:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1782529238.395408:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c669568100) 00010000:00010000:1.0:1782529238.395440:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782529238.395448:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac278 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf03 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529238.395585:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:10497:x1869117108831872:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 15505us (15758us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1782529238.395595:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000020:00080000:1.0:1782529238.395600:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782529238.398383:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.398486:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108832128 00000100:00100000:0.0:1782529238.398498:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108832128 00000100:00100000:0.0:1782529238.398704:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:0.0:1782529238.398716:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:10497:x1869117108832128:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529238.398748:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529238.398777:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac294 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf0a expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.398902:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf0a expref: 46 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.398919:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf0a expref: 46 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.398940:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529238.398944:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529238.398948:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:0.0:1782529238.399008:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+46:10497:x1869117108832128:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 294us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529238.399033:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:2.0:1782529238.401697:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.401794:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108832384 00000100:00100000:3.0:1782529238.401817:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108832384 00000100:00100000:3.0:1782529238.401975:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:3.0:1782529238.401986:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+46:10497:x1869117108832384:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1782529238.402272:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:10497:x1869117108832384:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 287us (591us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1782529238.402279:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:2.0:1782529238.468724:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529238.468801:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108832512 00000100:00100000:1.0:1782529238.468830:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108832512 00000100:00100000:1.0:1782529238.469023:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:1.0:1782529238.469036:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:10507:x1869117108832512:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:1.0:1782529238.469155:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469182:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469199:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469218:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469226:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469234:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469529:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469557:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469564:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782529238.469749:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469765:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469772:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469780:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469787:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529238.469793:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469800:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469824:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:1.0:1782529238.469828:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529238.469867:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469875:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac29b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469899:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469906:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469912:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469917:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529238.469920:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469926:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469934:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c643b34900) 00010000:00010000:1.0:1782529238.469937:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529238.469940:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469946:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac2a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469964:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469971:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469976:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469989:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529238.469992:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.469998:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.470007:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:1.0:1782529238.470010:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529238.470013:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.470019:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529238.470128:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:10507:x1869117108832512:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 1091us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529238.470138:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 101 00010000:00010000:1.0:1782529238.471036:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529238.500557:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529238.500820:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108832768 00000100:00100000:3.0:1782529238.500946:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108832768 00000100:00100000:2.0:1782529238.501067:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 102 00000100:00100000:2.0:1782529238.501080:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:10510:x1869117108832768:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529238.501110:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529238.501140:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac2b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf11 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501243:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501262:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501276:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501293:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501323:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501330:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501778:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501788:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501796:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529238.501820:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782529238.501981:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501989:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.501996:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502003:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529238.502009:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502017:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502044:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529238.502047:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529238.502052:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502059:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502076:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502082:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502087:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502092:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529238.502094:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502100:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502107:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c669568800) 00010000:00010000:2.0:1782529238.502109:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529238.502112:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502117:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502180:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac2b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502195:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 49 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.502202:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:2.0:1782529238.502204:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529238.502207:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00a00, rc 0) 00000100:00100000:2.0:1782529238.502436:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+49:10510:x1869117108832768:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1356us (1891us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1782529238.502446:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 102 00000100:00100000:2.0:1782529238.507436:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529238.507790:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108832896 00000100:00100000:1.0:1782529238.507804:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108832896 00000100:00100000:1.0:1782529238.508048:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 103 00000100:00100000:1.0:1782529238.508061:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+49:10510:x1869117108832896:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1782529238.508157:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508178:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508214:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508253:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508260:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508267:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508273:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529238.508278:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508286:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508300:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:1.0:1782529238.508303:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782529238.508309:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.508315:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac2d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529238.508440:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+49:10510:x1869117108832896:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 380us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529238.508449:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 103 00000100:00100000:3.0:1782529238.510642:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.510920:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108833152 00000100:00100000:0.0:1782529238.510933:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108833152 00000100:00100000:0.0:1782529238.510991:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:0.0:1782529238.511002:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+49:10510:x1869117108833152:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1782529238.511313:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:10510:x1869117108833152:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 311us (683us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1782529238.511324:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:0.0:1782529238.583529:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529238.583755:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108833408 00000100:00100000:2.0:1782529238.583770:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108833408 00000100:00100000:2.0:1782529238.583883:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 104 00000100:00100000:2.0:1782529238.583895:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:10520:x1869117108833408:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529238.583928:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529238.583932:0:6616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782529238.583968:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adef5 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.583994:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529238.583999:0:6616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529238.584015:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac2da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf18 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.584170:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.584186:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.584195:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.584236:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.584252:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 50 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529238.584268:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f19ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117236480:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529238.585018:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7180 going to sleep for 11 seconds 00000100:00100000:2.0:1782529238.591690:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f19ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117236480:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529238.591732:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.593906:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529238.594170:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108833536 00000100:00100000:1.0:1782529238.594199:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108833536 00010000:00010000:1.0:1782529238.594251:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 51 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529238.594296:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:1.0:1782529238.594307:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+51:2343:x1869117108833536:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529238.594328:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529238.594335:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 51 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.594350:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 51 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.594385:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac2c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf11 expref: 51 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.594404:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:1.0:1782529238.594409:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.594430:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.594439:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.594475:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529238.594553:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:2343:x1869117108833536:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 246us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529238.594575:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00010000:00010000:2.0:1782529238.594658:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.594668:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529238.594696:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782529238.594960:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac2da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 51 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.594977:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 50 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.594985:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:2.0:1782529238.594988:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782529238.594990:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01c00, rc 0) 00000100:00100000:2.0:1782529238.595022:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:10520:x1869117108833408:12345-192.168.202.50@tcp:101:bash.0 Request processed in 11131us (11509us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1782529238.595031:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 104 00000100:00100000:0.0:1782529238.599014:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529238.599265:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117236608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529238.599339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529238.599662:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108833792 00000100:00100000:2.0:1782529238.599674:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108833792 00000100:00100000:2.0:1782529238.599740:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 105 00000100:00100000:2.0:1782529238.599753:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:10520:x1869117108833792:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:2.0:1782529238.600159:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.600184:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.600198:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529238.600263:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1782529238.600290:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c152d669 reply state 00000000351d832d transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529238.600301:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529238.600547:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117236608 00000100:00100000:3.0:1782529238.600554:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117236608 00000100:00100000:3.0:1782529238.600596:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782529238.600616:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3297:x1869117117236608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529238.600642:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529238.600706:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3297:x1869117117236608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529238.600714:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782529238.600781:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117236608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529238.601033:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+53:10520:x1869117108833792:12345-192.168.202.50@tcp:36:bash.0 Request processed in 1281us (2033us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1782529238.601041:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 105 00000020:00080000:2.0:1782529238.601046:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782529238.606758:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529238.606882:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108833920 00000100:00100000:2.0:1782529238.606895:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108833920 00000100:00100000:2.0:1782529238.606972:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00100000:2.0:1782529238.606984:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+53:10520:x1869117108833920:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529238.607016:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529238.607042:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac2f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf1f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.607152:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.607170:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 54 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.607178:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.607187:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.607208:0:5794:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.607240:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 54 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.607279:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 54 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529238.607297:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f19ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117236736:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529238.608083:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7d80 going to sleep for 11 seconds 00010000:00010000:3.0:1782529238.609681:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.609703:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.609712:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.609719:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529238.609724:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.609733:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.609755:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:3.0:1782529238.609758:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529238.609761:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.609772:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.609778:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac2ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.610939:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529238.611075:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f19ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117236736:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529238.611108:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529238.611549:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108834048 00000100:00100000:3.0:1782529238.611558:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108834048 00010000:00010000:3.0:1782529238.611605:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 54 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529238.611651:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1782529238.611662:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:2343:x1869117108834048:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529238.611681:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529238.611688:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 54 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.611702:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 54 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.611728:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac2e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf18 expref: 54 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.611746:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:3.0:1782529238.611752:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.611763:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.611772:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529238.611813:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529238.611927:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+53:2343:x1869117108834048:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 266us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529238.611935:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00010000:00010000:2.0:1782529238.612069:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.612077:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529238.612137:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782529238.612142:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529238.612169:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.612207:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac2f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.612225:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 52 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.612232:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:2.0:1782529238.612243:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529238.612247:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00200, rc 0) 00000100:00100000:2.0:1782529238.612276:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:10520:x1869117108833920:12345-192.168.202.50@tcp:101:bash.0 Request processed in 5295us (5534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529238.612283:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00100000:1.0:1782529238.615919:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.616114:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108834304 00000100:00100000:0.0:1782529238.616128:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108834304 00000100:00100000:0.0:1782529238.616200:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:0.0:1782529238.616211:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:10520:x1869117108834304:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:0.0:1782529238.616724:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+53:10520:x1869117108834304:12345-192.168.202.50@tcp:35:bash.0 Request processed in 513us (818us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1782529238.616735:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:0.0:1782529238.672248:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529238.672392:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108834432 00000100:00100000:1.0:1782529238.672406:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108834432 00000100:00100000:1.0:1782529238.672493:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 107 00000100:00100000:1.0:1782529238.672505:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+53:10526:x1869117108834432:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529238.672539:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529238.672571:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf26 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.672670:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac30b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.672688:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.672701:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529238.672785:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1782529238.672790:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529238.672899:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.672931:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf26 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.672982:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac30b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf26 expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.672993:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:1.0:1782529238.672997:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782529238.673002:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6600, rc 0) 00000100:00100000:1.0:1782529238.673075:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:10526:x1869117108834432:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 571us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529238.673083:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 107 00000100:00100000:2.0:1782529238.676890:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.676995:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108834560 00000100:00100000:0.0:1782529238.677007:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108834560 00000100:00100000:0.0:1782529238.677082:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 108 00000100:00100000:0.0:1782529238.677094:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:10526:x1869117108834560:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529238.677141:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529238.677168:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf2d expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677253:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677272:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677284:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677299:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677306:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677311:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677465:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677474:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677482:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529238.677529:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782529238.677543:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529238.677571:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677586:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677597:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677604:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677612:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677618:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529238.677623:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677631:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677645:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:0.0:1782529238.677648:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529238.677653:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677660:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac319 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677675:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677691:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677697:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677702:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529238.677706:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677712:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677719:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c642b0fc00) 00010000:00010000:0.0:1782529238.677721:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529238.677724:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677730:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677766:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf2d expref: 56 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677779:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf2d expref: 55 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.677787:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529238.677790:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529238.677799:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031c00, rc 0) 00000100:00100000:0.0:1782529238.677934:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:10526:x1869117108834560:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 841us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529238.677942:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 108 00000100:00100000:0.0:1782529238.681917:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.681962:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529238.682223:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108834816 00000100:00100000:1.0:1782529238.682236:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108834816 00000100:00100000:1.0:1782529238.682312:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 109 00000100:00100000:1.0:1782529238.682324:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:10526:x1869117108834816:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529238.682352:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529238.682377:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac32e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf34 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.682518:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.682535:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.682544:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf2d expref: 56 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.682567:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.682621:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf2d expref: 56 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.682637:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf2d expref: 56 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529238.682654:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117236864:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529238.682766:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529238.682777:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 56 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529238.682787:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67869c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117236992:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529238.682825:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6454266c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782529238.685232:0:5795:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.50@tcp) returned -22 from blocking AST (req@0000000021c35a7c x1869117117236864) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf2d expref: 56 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.685263:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf2d expref: 56 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.685292:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf2d expref: 56 pid: 6616 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.685313:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117236864:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529238.685330:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67869c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117236992:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529238.685370:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529238.685377:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.685387:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.685397:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529238.686707:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529238.688298:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108834944 00000100:00100000:2.0:1782529238.688313:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108834944 00000100:00100000:2.0:1782529238.688398:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108835072 00000100:00100000:2.0:1782529238.688402:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108835072 00010000:00010000:2.0:1782529238.688434:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 57 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529238.688471:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:2.0:1782529238.688481:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650285c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:2343:x1869117108835072:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529238.688501:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529238.688508:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 57 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.688522:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 57 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.688550:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac2fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf1f expref: 57 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.688567:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:2.0:1782529238.688574:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.688624:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.688633:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.688665:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529238.688730:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650285c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:2343:x1869117108835072:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 250us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529238.688739:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:2.0:1782529238.688760:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1782529238.688767:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:2341:x1869117108834944:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529238.688774:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529238.688778:0:8316:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 72bfdc08f7eac327) 00010000:00010000:2.0:1782529238.688779:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529238.688796:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:2341:x1869117108834944:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 30us (6833us total) trans 0 rc 116/116 00000100:00100000:2.0:1782529238.688802:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00010000:00010000:0.0:1782529238.690254:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.690272:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529238.690300:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782529238.690519:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac32e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 56 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.690542:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.690551:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529238.690555:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782529238.690559:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6800, rc 0) 00000100:00100000:0.0:1782529238.690894:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:10526:x1869117108834816:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 8571us (8989us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1782529238.690905:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 109 00000100:00100000:0.0:1782529238.696242:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529238.696360:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108835328 00000100:00100000:2.0:1782529238.696374:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108835328 00000100:00100000:2.0:1782529238.696516:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:2.0:1782529238.696528:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:10526:x1869117108835328:12345-192.168.202.50@tcp:103:lfs.0 00010000:00010000:2.0:1782529238.696550:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529238.696582:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac294 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf0a expref: 55 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529238.696645:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:2.0:1782529238.696652:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529238.696737:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:10526:x1869117108835328:12345-192.168.202.50@tcp:103:lfs.0 Request processed in 209us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529238.696747:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:3.0:1782529238.699057:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.699185:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108835456 00000100:00100000:0.0:1782529238.699198:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108835456 00000100:00100000:0.0:1782529238.699265:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 110 00000100:00100000:0.0:1782529238.699276:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:10526:x1869117108835456:12345-192.168.202.50@tcp:58:lfs.0 00010000:00010000:0.0:1782529238.699467:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.699489:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.699514:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782529238.699902:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1782529238.700018:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:10526:x1869117108835456:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 741us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529238.700028:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 110 00000100:00100000:3.0:1782529238.702412:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529238.702894:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108835584 00000100:00100000:0.0:1782529238.702907:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108835584 00000100:00100000:0.0:1782529238.702971:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 111 00000100:00100000:0.0:1782529238.702982:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:10526:x1869117108835584:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529238.703009:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529238.703036:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf3b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.703108:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.703121:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf3b expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.703143:0:5796:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.703158:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf3b expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.703173:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529238.703192:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529238.703197:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf3b expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529238.703206:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030000, rc 0) 00000100:00100000:0.0:1782529238.703276:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:10526:x1869117108835584:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 295us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529238.703284:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 111 00000040:00080000:2.0:1782529239.175610:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529239.175624:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529239.175672:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1782529239.175682:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782529239.175901:0:11551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f198700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117237120:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782529239.176023:0:11551:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7780 going to sleep for 11 seconds 00000100:00100000:3.0:1782529239.202705:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.202869:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108835712 00000100:00100000:0.0:1782529239.202882:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108835712 00000100:00100000:0.0:1782529239.202974:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 112 00000100:00100000:0.0:1782529239.202988:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:10528:x1869117108835712:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782529239.203036:0:6616:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782529239.203170:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:10528:x1869117108835712:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 185us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529239.203179:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 112 00000100:00100000:2.0:1782529239.204902:0:11551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f198700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117237120:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1782529239.205177:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529239.228710:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.229048:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108835840 00000100:00100000:2.0:1782529239.229062:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108835840 00000100:00100000:2.0:1782529239.229144:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 113 00000100:00100000:2.0:1782529239.229156:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:10528:x1869117108835840:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782529239.229261:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229284:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229301:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229456:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229491:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229504:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229535:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229545:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229552:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529239.229728:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782529239.229733:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529239.229749:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229761:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229768:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229776:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.229782:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529239.229786:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230606:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230627:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:2.0:1782529239.230631:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529239.230636:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230643:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac351 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230660:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230667:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230674:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230679:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529239.230683:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230688:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230695:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff99c669568800) 00010000:00010000:2.0:1782529239.230698:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529239.230701:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230720:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac358 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230738:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230744:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230750:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230756:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529239.230759:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230765:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230773:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:2.0:1782529239.230775:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529239.230779:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.230784:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac35f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.231263:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:10528:x1869117108835840:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 2104us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529239.231274:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 113 00000100:00100000:3.0:1782529239.234780:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.236486:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108836096 00000100:00100000:0.0:1782529239.236500:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108836096 00000100:00100000:0.0:1782529239.236615:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:0.0:1782529239.236626:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:10528:x1869117108836096:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529239.236647:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529239.236667:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac366 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf42 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.236771:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.236817:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.236828:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529239.236864:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782529239.236978:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.236986:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.236992:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.236997:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529239.237001:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.237008:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.237019:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529239.237022:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782529239.237026:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.237034:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac36d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.237074:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac366 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf42 expref: 57 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.237096:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:0.0:1782529239.237098:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529239.237103:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac366 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf42 expref: 57 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.237112:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031400, rc 0) 00000100:00100000:0.0:1782529239.237192:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:10528:x1869117108836096:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 568us (2421us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1782529239.237201:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:1.0:1782529239.240644:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.240746:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108836224 00000100:00100000:0.0:1782529239.240756:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108836224 00000100:00100000:0.0:1782529239.240822:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:0.0:1782529239.240854:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:10528:x1869117108836224:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782529239.241097:0:5795:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782529239.241207:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:10528:x1869117108836224:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 375us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529239.241215:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:1.0:1782529239.246496:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.247307:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108836480 00000100:00100000:3.0:1782529239.247318:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108836480 00000100:00100000:3.0:1782529239.247579:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:3.0:1782529239.247590:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:10528:x1869117108836480:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529239.247619:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529239.247622:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782529239.247646:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac30b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf26 expref: 56 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.247664:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:3.0:1782529239.247669:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529239.247681:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac37b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf49 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782529239.248121:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1782529239.248636:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.248651:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.248661:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.248722:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac37b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf49 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.248740:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf49 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.248747:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:3.0:1782529239.248751:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529239.248753:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972ac00, rc 0) 00000100:00100000:3.0:1782529239.249014:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:10528:x1869117108836480:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1424us (2523us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1782529239.249023:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:3.0:1782529239.255920:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.256101:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108836736 00000100:00100000:2.0:1782529239.256112:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108836736 00000100:00100000:2.0:1782529239.256173:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:2.0:1782529239.256183:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:10528:x1869117108836736:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782529239.256239:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529239.256264:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf49 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256284:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:2.0:1782529239.256297:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529239.256317:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256330:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256350:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256365:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256371:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256377:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256456:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256480:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256486:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256492:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529239.256496:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256503:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256512:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529239.256514:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529239.256519:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256525:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac390 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256535:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256541:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256547:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256551:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529239.256560:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256566:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256573:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x21e553a2 (ffff99c669568800) 00010000:00010000:2.0:1782529239.256575:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529239.256578:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.256583:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x21e553a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.256655:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:10528:x1869117108836736:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 474us (743us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782529239.256664:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:1.0:1782529239.260459:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.260694:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108836864 00000100:00100000:0.0:1782529239.260704:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108836864 00000100:00100000:0.0:1782529239.260813:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:0.0:1782529239.260857:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:10528:x1869117108836864:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529239.260877:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529239.260900:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac39e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf50 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.260952:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.260965:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.260977:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.261067:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac39e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 58 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.261085:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 57 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.261093:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529239.261096:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782529239.261099:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031c00, rc 0) 00000100:00100000:0.0:1782529239.261158:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:10528:x1869117108836864:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 328us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529239.261166:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:1.0:1782529239.278164:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.278221:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108837120 00000100:00100000:2.0:1782529239.278230:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108837120 00000100:00100000:2.0:1782529239.278290:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:2.0:1782529239.278300:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:10528:x1869117108837120:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782529239.278389:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.278407:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.278419:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782529239.278665:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1782529239.278689:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301190855263ns, next at 302190852794ns, rc = 0 00000004:00010000:2.0:1782529239.278782:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000341d4bbc reply state 0000000017497d7a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.278792:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529239.278937:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:10528:x1869117108837120:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 637us (781us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1782529239.278945:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 119 00010000:00010000:1.0:1782529239.283067:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.283170:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.283177:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.283183:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529239.283188:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.283196:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.283212:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:1.0:1782529239.283214:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782529239.283219:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.283224:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.284041:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.284230:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108837248 00000100:00100000:2.0:1782529239.284241:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108837248 00000100:00100000:2.0:1782529239.284335:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:2.0:1782529239.284355:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:10528:x1869117108837248:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782529239.284379:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529239.284395:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf57 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.284457:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.284470:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.284488:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:2.0:1782529239.284491:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782529239.284494:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00c00, rc 0) 00000100:00100000:2.0:1782529239.284555:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:10528:x1869117108837248:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 211us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529239.284563:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:1.0:1782529239.288859:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.289018:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108837376 00000100:00100000:3.0:1782529239.289027:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108837376 00000100:00100000:3.0:1782529239.289109:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:3.0:1782529239.289121:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108837376:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1782529239.289454:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108837376:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 335us (623us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782529239.289462:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00080000:1.0:1782529239.289754:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529239.293175:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.293279:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108837632 00000100:00100000:2.0:1782529239.293288:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108837632 00000100:00100000:2.0:1782529239.293349:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:2.0:1782529239.293359:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:10528:x1869117108837632:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782529239.293593:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:10528:x1869117108837632:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 234us (426us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1782529239.293601:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:3.0:1782529239.296569:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.296670:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108837888 00000100:00100000:2.0:1782529239.296679:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108837888 00000100:00100000:2.0:1782529239.296736:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:2.0:1782529239.296745:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:10528:x1869117108837888:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782529239.296900:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:10528:x1869117108837888:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 155us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529239.296908:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:1.0:1782529239.299503:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.299584:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108838016 00000100:00100000:0.0:1782529239.299592:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108838016 00000100:00100000:0.0:1782529239.299654:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:0.0:1782529239.299662:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:10528:x1869117108838016:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529239.299679:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529239.299698:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac3ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf5e expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.299771:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eac3c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.299784:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eac3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.299794:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eac3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529239.299873:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529239.299890:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eac3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.299912:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac3ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf5e expref: 62 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.299929:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eac3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf5e expref: 61 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.299938:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529239.299941:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782529239.299944:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030c00, rc 0) 00000100:00100000:0.0:1782529239.299996:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:10528:x1869117108838016:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 334us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529239.300002:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:3.0:1782529239.302742:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.303049:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108838144 00000100:00100000:0.0:1782529239.303059:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108838144 00000100:00100000:0.0:1782529239.303276:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:0.0:1782529239.303299:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108838144:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529239.303315:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529239.303345:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf65 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782529239.303371:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3f3cd7, blocks: 0x1 00010000:00010000:0.0:1782529239.303389:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1782529239.303393:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529239.303402:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.303430:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.303443:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:0.0:1782529239.303496:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2344:x1869117108838144:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 199us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529239.303504:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:3.0:1782529239.306541:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529239.306930:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108838400 00000100:00100000:1.0:1782529239.306941:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108838400 00000100:00100000:1.0:1782529239.306995:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:1.0:1782529239.307005:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:10528:x1869117108838400:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782529239.307101:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:10528:x1869117108838400:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 97us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529239.307114:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:1.0:1782529239.311110:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.311244:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108838528 00000100:00100000:3.0:1782529239.311254:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108838528 00000100:00100000:3.0:1782529239.311366:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:3.0:1782529239.311377:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:10528:x1869117108838528:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529239.311396:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529239.311422:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf6c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.311452:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.311462:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529239.311466:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529239.311472:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 11 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.311501:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.311514:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 11 pid: 6591 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.311529:0:6593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1869117117237248:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529239.311619:0:6593:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b900 going to sleep for 11 seconds 00000100:00100000:3.0:1782529239.315781:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.315883:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108838656 00000100:00100000:0.0:1782529239.315893:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108838656 00010000:00010000:0.0:1782529239.315934:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 12 pid: 6591 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529239.315975:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:0.0:1782529239.315984:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:2343:x1869117108838656:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529239.316010:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529239.316031:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 12 pid: 6591 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.316044:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 12 pid: 6591 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.316068:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529239.316073:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529239.316091:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 12 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.316100:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 12 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.316137:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 12 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529239.316151:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660028000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5780:1869117117237376:192.168.202.50@tcp:105: 00000100:00100000:0.0:1782529239.316231:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fef0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782529239.316992:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ea29076/0x72bfdc08f7eac3c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf65 expref: 12 pid: 6591 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529239.317011:0:6593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1869117117237248:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529239.317036:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 11 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.317046:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972be00, rc 0) 00000100:00100000:1.0:1782529239.317100:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:10528:x1869117108838528:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 5725us (5998us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529239.317108:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:0.0:1782529239.324257:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660028000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5780:1869117117237376:192.168.202.50@tcp:105: 00010000:00010000:0.0:1782529239.324285:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529239.324348:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2343:x1869117108838656:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 8363us (8573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529239.324360:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:3.0:1782529239.328281:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.328517:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108838784 00000100:00100000:2.0:1782529239.328529:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108838784 00002000:00100000:2.0:1782529239.328577:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99c67f1d7800 x1869117108838784/t0(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:675/0 lens 504/0 e 0 to 0 dl 1782529250 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782529239.328591:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67f1d7800 with x1869117108838784 ext(0->12) 00002000:00010000:2.0:1782529239.328596:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67f1d7800 00000100:00100000:2.0:1782529239.328629:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:2.0:1782529239.328638:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2344:x1869117108838784:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782529239.329156:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:2344:x1869117108838784:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 Request processed in 517us (882us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782529239.329164:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00002000:00100000:2.0:1782529239.329177:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99c67f1d7800 x1869117108838784/t4294967308(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:675/0 lens 504/448 e 0 to 0 dl 1782529250 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782529239.329185:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67f1d7800 with x1869117108838784 ext(0->12) 00002000:00010000:2.0:1782529239.329189:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67f1d7800 00000100:00100000:2.0:1782529239.332759:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.332864:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108838912 00000100:00100000:0.0:1782529239.332874:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108838912 00000100:00100000:0.0:1782529239.332929:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:0.0:1782529239.332939:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:10528:x1869117108838912:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782529239.364557:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:1.0:1782529239.364601:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1782529239.364637:0:5816:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99c681601c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1782529239.364643:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6780be100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99c681601d80 00000020:00080000:1.0:1782529239.364647:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6780bec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99c67fe64000 00000001:00080000:1.0:1782529239.364661:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1782529239.364669:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1782529239.364692:0:5816:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99c5428d7f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1782529239.364696:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6453c6700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99c5428d7240 00000020:00080000:1.0:1782529239.364699:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6453c6900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99c67f7a9c00 00000004:00080000:1.0:1782529239.364707:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1782529239.364773:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1782529239.365019:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1782529239.365152:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67869c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117237504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782529239.365219:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529239.365257:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529239.365264:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67869ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117237632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782529239.365287:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529239.365317:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117237504 00000100:00100000:1.0:1782529239.365323:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117237504 00000100:00100000:1.0:1782529239.365369:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117237632 00000100:00100000:1.0:1782529239.365372:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117237632 00000100:00100000:1.0:1782529239.365393:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782529239.365401:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1869117117237504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782529239.365438:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1782529239.365464:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.365486:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.365496:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782529239.365500:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782529239.365505:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.365534:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.365562:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 11 pid: 6592 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529239.365576:0:6592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67869df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6592:1869117117237760:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529239.365637:0:6592:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426600 going to sleep for 11 seconds 00000100:00080000:1.0:1782529239.365650:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529239.365664:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782529239.365673:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3294:x1869117117237632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1782529239.365812:0:8328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782529239.365816:0:8328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782529239 00002000:00010000:1.0:1782529239.365818:0:8328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782529239.365821:0:8328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782529239 -> 1782529239 00002000:00010000:1.0:1782529239.365823:0:8328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782529239.365884:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1869117117237632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (596us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782529239.365891:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1782529239.366020:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c67869ed80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1782529239.366027:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67869ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117237632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782529239.366496:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:10528:x1869117108838912:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 33554us (33741us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529239.366504:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:1.0:1782529239.367025:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117237888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782529239.367064:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529239.368211:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117237888 00000100:00100000:0.0:1782529239.368221:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117237888 00000100:00100000:1.0:1782529239.368490:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782529239.368501:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1869117117237888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782529239.368528:0:8328:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1782529239.368571:0:8328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3f3cd6, atime: 0x6a3f3cd6, ctime: 0x6a3f3cd6, blocks: 0x1 00010000:00010000:1.0:1782529239.368579:0:8328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.368594:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=301s v=(0 0) 00010000:00010000:1.0:1782529239.368599:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529239.368605:0:8328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.368619:0:8328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.368627:0:8328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.368636:0:8328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.368701:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782529239.369484:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3296:x1869117117237888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 982us (2417us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782529239.369494:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1782529239.371740:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782529239.371755:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.371769:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:3.0:1782529239.371773:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.371783:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.371814:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.371823:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0d0d27b/0x72bfdc08f7eac3dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.371864:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529239.371866:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529239.371867:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782529239.371950:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c660028000/2, rc 0, transno 4294967304 00000100:00100000:0.0:1782529239.371959:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117237888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782529239.372541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.372968:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108839040 00000100:00100000:3.0:1782529239.372976:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108839040 00010000:00010000:3.0:1782529239.373011:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 12 pid: 6592 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.373207:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:3.0:1782529239.373218:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:2344:x1869117108839040:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529239.373249:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529239.373254:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 12 pid: 6592 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.373266:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 12 pid: 6592 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.373288:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529239.373293:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529239.373298:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.373307:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.373326:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782529239.373639:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001421fc5c/0x72bfdc08f7eac198 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adecb expref: 12 pid: 6592 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529239.373655:0:6592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67869df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6592:1869117117237760:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529239.373677:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.373695:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.373701:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.373710:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.373716:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.373739:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782529239.374325:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3294:x1869117117237504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8922us (9103us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782529239.374335:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1782529239.374393:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c67869c000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1782529239.374400:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67869c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117237504:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782529239.374647:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529239.374654:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.374663:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529239.374667:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.374676:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.374689:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.374696:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eac3d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.374712:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529239.374715:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529239.374724:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529239.374858:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:2344:x1869117108839040:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 1641us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529239.374867:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:2.0:1782529239.375033:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.375146:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108839168 00000100:00100000:0.0:1782529239.375152:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108839168 00000100:00100000:0.0:1782529239.375195:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:0.0:1782529239.375204:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:2344:x1869117108839168:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1782529239.410721:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1782529239.410743:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1782529239.410751:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1782529239.410760:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1782529239.410947:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108839168:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 35738us (35908us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529239.410958:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:0.0:1782529239.414674:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.414824:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108839424 00000100:00100000:2.0:1782529239.414859:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108839424 00000100:00100000:2.0:1782529239.414915:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:2.0:1782529239.414926:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:10528:x1869117108839424:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782529239.414983:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529239.415010:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eac3c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf5e expref: 15 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.415030:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:2.0:1782529239.415034:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529239.415064:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.415183:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.415195:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529239.415528:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068992b79 reply state 00000000b76bd153 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.415538:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529239.415694:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:10528:x1869117108839424:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 768us (1029us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1782529239.415702:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:2.0:1782529239.420451:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529239.420619:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108839552 00000100:00100000:1.0:1782529239.420629:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108839552 00000100:00100000:1.0:1782529239.420689:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:1.0:1782529239.420698:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108839552:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782529239.420984:0:8328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1782529239.420988:0:8328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1782529239 -> 1782529238 00002000:00010000:1.0:1782529239.421004:0:8328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782529238 00002000:00010000:1.0:1782529239.421006:0:8328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782529239 -> 1782529238 00002000:00010000:1.0:1782529239.421008:0:8328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782529239.421070:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108839552:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 371us (625us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782529239.421283:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00010000:00010000:3.0:1782529239.421542:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.421552:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.421566:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.421572:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529239.421577:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.421584:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.421647:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:3.0:1782529239.421651:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529239.421657:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.421664:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac3e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.425196:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.425295:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108839808 00000100:00100000:3.0:1782529239.425305:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108839808 00000100:00100000:3.0:1782529239.425531:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:3.0:1782529239.425543:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:10528:x1869117108839808:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782529239.425610:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.425628:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 15 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.425639:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.425689:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 15 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.425704:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 15 pid: 6616 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.425719:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117238016:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529239.425906:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529239.434474:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529239.434561:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108839936 00000100:00100000:2.0:1782529239.434571:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108839936 00010000:00010000:2.0:1782529239.434610:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 16 pid: 6616 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.434650:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:2.0:1782529239.434659:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:2344:x1869117108839936:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529239.434674:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529239.434681:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 16 pid: 6616 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.434694:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 16 pid: 6616 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.434717:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:2.0:1782529239.434723:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.434752:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.434760:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.434778:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529239.434867:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:2344:x1869117108839936:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 209us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529239.434874:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00010000:00010000:3.0:1782529239.435464:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac3a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf50 expref: 15 pid: 6616 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.435485:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117238016:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529239.435505:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435513:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435519:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435546:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435552:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435559:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435574:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529239.435579:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435586:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435596:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:3.0:1782529239.435598:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782529239.435602:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.435607:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac3eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.435652:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:10528:x1869117108839808:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 Request processed in 10112us (10466us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782529239.435660:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:1.0:1782529239.440145:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.440285:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108840064 00000100:00100000:3.0:1782529239.440295:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108840064 00000100:00100000:3.0:1782529239.440514:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:3.0:1782529239.440525:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108840064:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782529239.440567:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.440586:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.440629:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529239.440634:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529239.440638:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.440671:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.440685:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 7 pid: 6593 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.440699:0:6593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1869117117238144:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529239.440783:0:6593:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529239.444616:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.444730:0:6593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1869117117238144:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529239.444757:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.444891:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108840192 00000100:00100000:2.0:1782529239.444898:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108840192 00010000:00010000:2.0:1782529239.444934:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 8 pid: 6593 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.444975:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:2.0:1782529239.444984:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108840192:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529239.444998:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529239.445016:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 8 pid: 6593 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.445027:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 8 pid: 6593 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.445051:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d330cf5/0x72bfdc08f7eac3cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf6c expref: 8 pid: 6593 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.445095:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529239.445100:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529239.445105:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.445114:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.445142:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529239.445198:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108840192:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 214us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529239.445206:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00010000:00010000:3.0:1782529239.445330:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.445339:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.445362:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.445376:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.445383:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.445389:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:3.0:1782529239.445394:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.445402:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.445424:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.445432:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac3f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.445477:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108840064:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 4954us (5409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529239.445485:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:2.0:1782529239.452659:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529239.452795:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108840448 00000100:00100000:0.0:1782529239.452815:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108840448 00000100:00100000:0.0:1782529239.452913:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:0.0:1782529239.452923:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:10528:x1869117108840448:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782529239.453000:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.453020:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.453032:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.453486:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.453497:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.453505:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.453534:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.453548:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 15 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529239.453562:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117238272:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529239.453681:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646abd300 going to sleep for 11 seconds 00000100:00100000:2.0:1782529239.457998:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117238272:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529239.458027:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.460372:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.461270:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108840576 00000100:00100000:3.0:1782529239.461283:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108840576 00010000:00010000:3.0:1782529239.461329:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 16 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.461566:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:3.0:1782529239.461576:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+16:2344:x1869117108840576:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529239.461591:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529239.461608:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 16 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.461621:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 16 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.461642:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac3b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf57 expref: 16 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.461659:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:3.0:1782529239.461664:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.461673:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.461679:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.461709:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529239.461779:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:2344:x1869117108840576:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 204us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529239.461787:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00010000:00010000:2.0:1782529239.462635:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529239.462648:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529239.462891:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1782529239.463044:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1782529239.463227:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1782529239.463351:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f19aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869117117238400:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782529239.463531:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529239.463566:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645426d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782529239.464042:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117238400 00000100:00100000:0.0:1782529239.464050:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117238400 00000100:00100000:0.0:1782529239.464105:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782529239.464114:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1869117117238400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782529239.464190:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1869117117238400:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529239.464206:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782529239.464240:0:5795:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1782529239.464245:0:5795:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1782529239.464261:0:5795:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c67869ed80, transno 4294967309 00000004:00080000:0.0:1782529239.464271:0:5795:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c67869c000, transno 4294967310 00000100:00100000:0.0:1782529239.464277:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f19aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869117117238400:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1782529239.464731:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1782529239.464791:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c66002b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869117117238528:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782529239.464878:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529239.464899:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fef780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529239.465167:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117238528 00000100:00100000:0.0:1782529239.465173:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117238528 00000100:00100000:0.0:1782529239.465196:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782529239.465203:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1869117117238528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782529239.465358:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1869117117238528:12345-0@lo:1000:mdt00_001.0 Request processed in 154us (479us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1782529239.465365:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782529239.465401:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c66002b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869117117238528:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1782529239.465431:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465440:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465446:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465461:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529239.465467:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465474:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465488:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529239.465491:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529239.465495:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465500:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac400 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465526:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465533:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465538:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465543:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529239.465546:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465551:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465569:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529239.465570:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529239.465579:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf3b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465590:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf3b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465598:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf3b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.465621:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf3b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529239.465632:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660028a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117238656:192.168.202.50@tcp:105: 00000100:00100000:0.0:1782529239.465697:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fef780 going to sleep for 11 seconds 00000100:00100000:2.0:1782529239.470256:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.470317:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108840704 00000100:00100000:3.0:1782529239.470350:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108840704 00000100:00100000:3.0:1782529239.470415:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:3.0:1782529239.470425:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10526:x1869117108840704:12345-192.168.202.50@tcp:49:lfs.0 00000100:00100000:3.0:1782529239.470554:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10526:x1869117108840704:12345-192.168.202.50@tcp:49:lfs.0 Request processed in 130us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529239.470563:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1782529239.474556:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660028a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117238656:192.168.202.50@tcp:105: 00010000:00010000:0.0:1782529239.474590:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474601:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac343 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474638:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474652:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474679:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474690:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474696:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474703:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474709:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529239.474712:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474719:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474729:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529239.474732:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529239.474735:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474741:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac407 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474750:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474756:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474765:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474770:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529239.474773:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474779:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474785:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529239.474787:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782529239.474790:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.474795:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac3f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529239.475047:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:10528:x1869117108840448:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 22123us (22395us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1782529239.475057:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 127 00000020:00080000:0.0:1782529239.475062:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782529239.475287:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529239.475292:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529239.475898:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1782529239.475908:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782529239.479213:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.480016:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108841216 00000100:00100000:3.0:1782529239.480027:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108841216 00000100:00100000:3.0:1782529239.480185:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:3.0:1782529239.480195:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:10528:x1869117108841216:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782529239.481266:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529239.482144:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108840960 00000100:00100000:1.0:1782529239.482152:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108840960 00000100:00100000:1.0:1782529239.482265:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 128 00000100:00100000:1.0:1782529239.482274:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:10526:x1869117108840960:12345-192.168.202.50@tcp:58:lfs.0 00000040:00080000:1.0:1782529239.482827:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1782529239.482937:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10526:x1869117108840960:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 663us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529239.482945:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 128 00000004:00080000:3.0:1782529239.483402:0:5797:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782529239.483505:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1782529239.483556:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.483572:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.483582:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.483591:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.483597:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.483603:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.483639:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782529239.483712:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10528:x1869117108841216:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 3519us (4508us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1782529239.483720:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000020:00080000:3.0:1782529239.483724:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782529239.483868:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529239.483875:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.483882:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529239.483886:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.483904:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.483917:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99c6601f9a00) 00010000:00010000:0.0:1782529239.483921:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782529239.483925:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.483931:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac40e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529239.483947:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529239.483949:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529239.483950:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529239.494982:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529239.526226:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529239.526315:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108841344 00000100:00100000:1.0:1782529239.526323:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108841344 00000100:00100000:1.0:1782529239.526378:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 129 00000100:00100000:1.0:1782529239.526387:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:10530:x1869117108841344:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529239.526420:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529239.526438:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf73 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.526490:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.526500:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.526508:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.526519:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.526523:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.526527:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.527097:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.527108:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.527116:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.527149:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.527163:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 21 pid: 5795 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529239.527178:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117238784:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529239.527253:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646abdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529239.530235:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117238784:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529239.530262:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529239.531439:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529239.531742:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108841600 00000100:00100000:1.0:1782529239.531752:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108841600 00000100:00100000:1.0:1782529239.531809:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:1.0:1782529239.531821:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:5558:x1869117108841600:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782529239.532093:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:5558:x1869117108841600:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 273us (657us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1782529239.532113:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1782529239.533953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529239.534350:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108841728 00000100:00100000:3.0:1782529239.534359:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108841728 00010000:00010000:3.0:1782529239.534400:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 23 pid: 5795 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529239.534440:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:3.0:1782529239.534449:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650287c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:2343:x1869117108841728:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529239.534464:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529239.534471:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 23 pid: 5795 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.534484:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 23 pid: 5795 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.534501:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac335 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf34 expref: 23 pid: 5795 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.534514:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:3.0:1782529239.534517:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.534524:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.534540:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529239.534563:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529239.534615:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650287c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:2343:x1869117108841728:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 166us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529239.534623:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00010000:00010000:1.0:1782529239.536045:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536056:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529239.536099:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782529239.536103:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529239.536123:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536137:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536148:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536153:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536159:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536165:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529239.536169:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536177:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536190:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:1.0:1782529239.536204:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529239.536207:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536211:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac41c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536222:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536226:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536230:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536233:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529239.536234:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536237:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536242:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99c643b34b00) 00010000:00010000:1.0:1782529239.536243:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529239.536245:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536248:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536276:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf73 expref: 22 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536295:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf73 expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529239.536299:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:1.0:1782529239.536301:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782529239.536302:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6600, rc 0) 00000100:00100000:1.0:1782529239.536444:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10530:x1869117108841344:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 10057us (10226us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529239.536452:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 129 00000001:00080000:2.0:1782529239.732541:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1782529239.732565:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1782529239.732572:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1782529239.732587:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:3.0:1782529240.278401:0:11919:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529240.278410:0:11919:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529240.278452:0:11919:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782529240.278470:0:11919:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782529240.519088:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782529240.520233:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529240.520244:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529240.520287:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1782529240.520296:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782529240.520579:0:11551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f198000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117238912:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782529240.520693:0:11551:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c647e7a780 going to sleep for 11 seconds 00000100:00100000:3.0:1782529240.526007:0:11551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f198000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117238912:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782529240.539453:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529240.540076:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108841856 00000100:00100000:2.0:1782529240.540086:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108841856 00000100:00100000:2.0:1782529240.540147:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 130 00000100:00100000:2.0:1782529240.540158:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10542:x1869117108841856:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782529240.540192:0:5794:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782529240.540314:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10542:x1869117108841856:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 157us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529240.540322:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 130 00000100:00100000:2.0:1782529240.560022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529240.560209:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108842112 00000100:00100000:0.0:1782529240.560221:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108842112 00000100:00100000:0.0:1782529240.560280:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:0.0:1782529240.560299:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:10542:x1869117108842112:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529240.560321:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529240.560342:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac431 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf7a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529240.560443:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac438 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529240.560457:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529240.560495:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529240.560507:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782529240.560652:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac431 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf7a expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529240.560672:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf7a expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529240.560681:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:0.0:1782529240.560684:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529240.560688:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:0.0:1782529240.560913:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10542:x1869117108842112:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 623us (901us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1782529240.560921:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:0.0:1782529240.569699:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529240.569891:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108842240 00000100:00100000:1.0:1782529240.569901:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108842240 00000100:00100000:1.0:1782529240.570617:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1782529240.570683:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:2341:x1869117108842240:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529240.570700:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529240.570726:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf7a expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529240.570745:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:1.0:1782529240.570750:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529240.570812:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:2341:x1869117108842240:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 184us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529240.570819:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:2.0:1782529240.575184:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529240.580228:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108842496 00000100:00100000:3.0:1782529240.580244:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108842496 00000100:00100000:3.0:1782529240.580367:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 132 00000100:00100000:3.0:1782529240.580379:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:10542:x1869117108842496:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782529240.580481:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580500:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580513:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580706:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580714:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580734:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580741:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529240.580745:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580753:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580765:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:3.0:1782529240.580768:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782529240.580773:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529240.580779:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac446 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529240.580997:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10542:x1869117108842496:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 619us (5821us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1782529240.581006:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 132 00000040:00080000:2.0:1782529240.581151:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529240.581156:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529240.581693:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1782529240.581702:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782529240.592194:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529240.592284:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108842752 00000100:00100000:1.0:1782529240.592294:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108842752 00000100:00100000:1.0:1782529240.592409:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:1.0:1782529240.592432:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:10542:x1869117108842752:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782529240.592694:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:10542:x1869117108842752:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 262us (508us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1782529240.592703:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:0.0:1782529241.161702:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117239296:0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.161776:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529241.161860:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117239808:0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.161887:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529241.161917:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782529241.161923:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c66002aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117239168:0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.161951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529241.161974:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117239680:0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.162014:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529241.162054:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117239168 00000100:00100000:0.0:1782529241.162062:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117239168 00000100:00100000:0.0:1782529241.162107:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782529241.162115:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117239168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.162164:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117239168:12345-0@lo:400:kworker.0 Request processed in 49us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529241.162172:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782529241.162200:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117239296 00000100:00100000:0.0:1782529241.162203:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117239296 00000100:00100000:0.0:1782529241.162219:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117239680 00000100:00100000:0.0:1782529241.162221:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117239680 00000100:00100000:0.0:1782529241.162239:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782529241.162245:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117239296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.162275:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117239296:12345-0@lo:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529241.162282:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782529241.162293:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782529241.162299:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117239680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.162320:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117239680:12345-0@lo:400:kworker.0 Request processed in 22us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529241.162323:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1782529241.162334:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529241.162356:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c66002aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117239168:0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.162364:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117239680:0@lo:400:kworker.0 00000100:00100000:0.0:1782529241.162370:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117239296:0@lo:400:kworker.0 00000100:00100000:2.0:1782529241.163208:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117239040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529241.163252:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529241.163285:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117239552:0@lo:400:kworker.0 00000100:00100000:2.0:1782529241.163306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529241.163345:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782529241.163353:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c66002bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117239424:0@lo:400:kworker.0 00000100:00100000:2.0:1782529241.163375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529241.163407:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117239808 00000100:00100000:2.0:1782529241.163412:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117239808 00000100:00100000:2.0:1782529241.163448:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117239552 00000100:00100000:2.0:1782529241.163451:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117239552 00000100:00100000:2.0:1782529241.163470:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782529241.163477:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117239808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529241.163519:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117239808:12345-0@lo:400:kworker.0 Request processed in 43us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529241.163525:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782529241.163540:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782529241.163554:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1869117117239552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529241.163587:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117239040 00000100:00100000:2.0:1782529241.163590:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1869117117239552:12345-0@lo:400:kworker.0 Request processed in 36us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529241.163593:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117239040 00000100:00100000:2.0:1782529241.163600:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1782529241.163619:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782529241.163623:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529241.163630:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782529241.163633:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117239424 00000100:00100000:2.0:1782529241.163638:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117239424 00000100:00100000:1.0:1782529241.163641:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1869117117239040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782529241.163672:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529241.163674:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782529241.163683:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117239424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529241.163718:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1869117117239040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529241.163724:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117239424:12345-0@lo:400:kworker.0 Request processed in 40us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529241.163730:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782529241.163735:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1782529241.163752:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529241.163780:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c66002bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117239424:0@lo:400:kworker.0 00000100:00100000:1.0:1782529241.163802:0:3295:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1782529241.163808:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000100:00100000:2.0:1782529241.163813:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117239040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529241.163826:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117239552:0@lo:400:kworker.0 00000004:00080000:1.0:1782529241.163828:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c642b80380, transno 4294967301 00000004:00080000:1.0:1782529241.163862:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1782529241.163879:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c660028000, transno 4294967304 00000100:00100000:1.0:1782529241.163885:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117239808:0@lo:400:kworker.0 00010000:00010000:1.0:1782529241.551742:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782529242.180119:0:11971:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782529242.180129:0:11971:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782529242.180172:0:11971:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782529242.180177:0:11971:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782529242.427797:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529242.428076:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108843008 00000100:00100000:0.0:1782529242.428085:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108843008 00000100:00100000:2.0:1782529242.428396:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:2.0:1782529242.428407:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:10562:x1869117108843008:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529242.428439:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529242.428460:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac44d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf81 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529242.428573:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac454 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529242.428604:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac454 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529242.428616:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac454 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529242.428629:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782529242.428756:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac44d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf81 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529242.428784:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf81 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529242.428793:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:2.0:1782529242.428796:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782529242.428809:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01800, rc 0) 00000100:00100000:2.0:1782529242.428898:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:10562:x1869117108843008:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 493us (1122us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1782529242.428906:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00080000:0.0:1782529242.429602:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529242.434469:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529242.434754:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108843136 00000100:00100000:0.0:1782529242.434765:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108843136 00000100:00100000:3.0:1782529242.434975:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 134 00000100:00100000:3.0:1782529242.434989:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:10562:x1869117108843136:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1782529242.435056:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435073:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435102:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435128:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435136:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435143:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435149:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529242.435152:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435160:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435171:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:3.0:1782529242.435173:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782529242.435177:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.435183:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b000/0x72bfdc08f7eac462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529242.435264:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:10562:x1869117108843136:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 278us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529242.435272:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 134 00010000:00010000:0.0:1782529242.567208:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529242.624384:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529242.626757:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108843264 00000100:00100000:3.0:1782529242.626799:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108843264 00000100:00100000:3.0:1782529242.626921:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:3.0:1782529242.626933:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2341:x1869117108843264:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:3.0:1782529242.626950:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529242.626972:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac469 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf88 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782529242.626999:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3f3cd6, atime: 0x6a3f3cd6, ctime: 0x6a3f3cd6, blocks: 0xb 00010000:00010000:3.0:1782529242.627016:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:3.0:1782529242.627020:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529242.627030:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac469 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf88 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.627048:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac469 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf88 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529242.627061:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972b000, rc 0) 00000100:00100000:3.0:1782529242.627123:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2341:x1869117108843264:12345-192.168.202.50@tcp:101:cat.0 Request processed in 193us (2747us total) trans 0 rc 0/0 00000100:00080000:0.0:1782529242.627260:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529242.627288:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:2.0:1782529242.635867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529242.635985:0:6596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108843392 00000100:00100000:1.0:1782529242.635994:0:6596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108843392 00002000:00100000:1.0:1782529242.636046:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff99c67fac3480 x1869117108843392/t0(0) o3->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:678/0 lens 488/0 e 0 to 0 dl 1782529253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782529242.636058:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fac3480 with x1869117108843392 ext(0->4095) 00002000:00010000:1.0:1782529242.636064:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67fac3480 00000100:00100000:1.0:1782529242.636152:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1782529242.636163:0:6596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2342:x1869117108843392:12345-192.168.202.50@tcp:3:cat.0 00000100:00100000:1.0:1782529242.636421:0:6596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2342:x1869117108843392:12345-192.168.202.50@tcp:3:cat.0 Request processed in 259us (589us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1782529242.636429:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00002000:00100000:1.0:1782529242.636436:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff99c67fac3480 x1869117108843392/t0(0) o3->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:678/0 lens 488/4536 e 0 to 0 dl 1782529253 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782529242.636443:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fac3480 with x1869117108843392 ext(0->4095) 00002000:00010000:1.0:1782529242.636447:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67fac3480 00000100:00100000:2.0:1782529242.965693:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529242.965736:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529242.965813:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529242.965994:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108843776 00000100:00100000:0.0:1782529242.966005:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108843776 00000100:00100000:0.0:1782529242.966077:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00100000:0.0:1782529242.966087:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108843776:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529242.966161:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2344:x1869117108843776:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 76us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529242.966169:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00080000:2.0:1782529242.966299:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529242.966357:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108843648 00000100:00100000:1.0:1782529242.966362:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108843648 00000100:00100000:1.0:1782529242.966411:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:1.0:1782529242.966419:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108843648:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529242.966449:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2344:x1869117108843648:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 32us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529242.966455:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00080000:2.0:1782529242.966505:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529242.966665:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108843520 00000100:00100000:3.0:1782529242.966670:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108843520 00000100:00100000:3.0:1782529242.966706:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 289 00000100:00100000:3.0:1782529242.966712:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108843520:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529242.966752:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108843520:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529242.966786:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 289 00010000:00010000:2.0:1782529243.591509:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529243.719219:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782529243.719257:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117239936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529243.719336:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529243.719472:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117239936 00000100:00100000:3.0:1782529243.719480:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117239936 00000100:00100000:3.0:1782529243.719548:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782529243.719559:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117239936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529243.719593:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529243.719641:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117239936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529243.719648:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1782529243.719808:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529243.719875:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117239936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782529244.617126:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782529244.840604:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1782529244.840634:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1782529244.860087:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:1.0:1782529244.860115:0:5816:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99c646fef3c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1782529244.860121:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6785e0200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99c646fef240 00000020:00080000:1.0:1782529244.860124:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6785e0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99c67f193800 00000020:00080000:3.0:1782529244.860163:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1782529244.860467:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1782529244.866079:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1782529244.866119:0:5816:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1782529244.866595:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00010000:00010000:3.0:1782529245.640090:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529246.283936:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117240192:0@lo:400:kworker.0 00000100:00100000:3.0:1782529246.284008:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529246.284054:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117240704:0@lo:400:kworker.0 00000100:00100000:3.0:1782529246.284081:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529246.284113:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782529246.284119:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117240320:0@lo:400:kworker.0 00000100:00100000:3.0:1782529246.284141:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529246.284181:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117240192 00000100:00100000:3.0:1782529246.284188:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117240192 00000100:00100000:3.0:1782529246.284228:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117240320 00000100:00100000:3.0:1782529246.284231:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117240320 00000100:00100000:3.0:1782529246.284261:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782529246.284270:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117240192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529246.284346:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117240192:12345-0@lo:400:kworker.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529246.284479:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782529246.284500:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782529246.284506:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117240320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529246.284537:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117240320:12345-0@lo:400:kworker.0 Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529246.284551:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782529246.284572:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117240704 00000100:00100000:3.0:1782529246.284576:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117240704 00000100:00100000:3.0:1782529246.284605:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782529246.284611:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117240704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529246.284641:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117240704:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529246.284646:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1782529246.284663:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782529246.284667:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529246.284700:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117240320:0@lo:400:kworker.0 00000100:00100000:3.0:1782529246.284711:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117240192:0@lo:400:kworker.0 00000100:00100000:3.0:1782529246.284719:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117240704:0@lo:400:kworker.0 00000100:00100000:1.0:1782529246.285225:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117240064:0@lo:400:kworker.0 00000100:00100000:1.0:1782529246.285289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529246.285321:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117240576:0@lo:400:kworker.0 00000100:00100000:1.0:1782529246.285345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529246.285380:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782529246.285386:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117240448:0@lo:400:kworker.0 00000100:00100000:1.0:1782529246.285408:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529246.285436:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117240448 00000100:00100000:1.0:1782529246.285441:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117240448 00000100:00100000:1.0:1782529246.285471:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782529246.285479:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117240448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529246.285516:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117240448:12345-0@lo:400:kworker.0 Request processed in 39us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529246.285522:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782529246.285549:0:3297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1782529246.285554:0:3297:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1782529246.285570:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117240448:0@lo:400:kworker.0 00000100:00100000:1.0:1782529246.285585:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117240576 00000100:00100000:1.0:1782529246.285588:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117240576 00000100:00100000:1.0:1782529246.285610:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782529246.285617:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117240576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529246.285650:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117240576:12345-0@lo:400:kworker.0 Request processed in 34us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529246.285656:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782529246.285680:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117240576:0@lo:400:kworker.0 00000100:00100000:0.0:1782529246.285985:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117240064 00000100:00100000:0.0:1782529246.285991:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117240064 00000100:00100000:0.0:1782529246.286027:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782529246.286035:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117240064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529246.286075:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117240064:12345-0@lo:400:kworker.0 Request processed in 41us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529246.286082:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782529246.286191:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117240064:0@lo:400:kworker.0 00000100:00080000:3.0:1782529246.287695:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782529246.287704:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529246.289655:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117240832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529246.289730:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529246.290117:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117240832 00000100:00100000:1.0:1782529246.290134:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117240832 00000100:00100000:1.0:1782529246.290179:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782529246.290188:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117240832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782529246.290224:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529246.290289:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117240832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529246.290297:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782529246.290402:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117240832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782529246.668129:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529247.690572:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529248.080946:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529248.080984:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529248.081014:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529248.081041:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529248.081081:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529248.081106:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108844416 00000100:00100000:3.0:1782529248.081115:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108844416 00000100:00100000:3.0:1782529248.081165:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108844032 00000100:00100000:3.0:1782529248.081167:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108844032 00000100:00100000:3.0:1782529248.081185:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:3.0:1782529248.081193:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108844416:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529248.081261:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108844416:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529248.081269:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:3.0:1782529248.081284:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:3.0:1782529248.081289:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:2343:x1869117108844032:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529248.081314:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:2343:x1869117108844032:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529248.081320:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:3.0:1782529248.081339:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108844160 00000100:00100000:3.0:1782529248.081343:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108844160 00000100:00080000:2.0:1782529248.081462:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529248.081870:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108843904 00000100:00100000:0.0:1782529248.081876:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108843904 00000100:00100000:0.0:1782529248.081910:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 291 00000100:00100000:0.0:1782529248.081917:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108843904:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529248.081953:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108843904:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 37us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529248.081960:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 291 00000100:00100000:3.0:1782529248.082152:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108844288 00000100:00100000:3.0:1782529248.082157:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108844288 00000100:00100000:0.0:1782529248.082207:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:0.0:1782529248.082216:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108844160:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529248.082248:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108844160:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 33us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529248.082254:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00080000:2.0:1782529248.082866:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782529248.082871:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529248.083761:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:3.0:1782529248.083773:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108844288:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529248.083857:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108844288:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 87us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529248.083878:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:0.0:1782529248.248522:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529248.248630:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108844544 00000100:00100000:3.0:1782529248.248640:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108844544 00000100:00100000:3.0:1782529248.248702:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:3.0:1782529248.248712:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:10215:x1869117108844544:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1782529248.248903:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:10215:x1869117108844544:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529248.248911:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:1.0:1782529248.276669:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529248.276805:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108844800 00000100:00100000:0.0:1782529248.276856:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108844800 00000100:00100000:0.0:1782529248.276926:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:0.0:1782529248.276937:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:10215:x1869117108844800:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782529248.277478:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:10215:x1869117108844800:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 542us (825us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1782529248.277484:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:2.0:1782529248.586703:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529248.589228:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108844928 00000100:00100000:0.0:1782529248.589245:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108844928 00000100:00100000:0.0:1782529248.589438:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:0.0:1782529248.589463:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:11014:x1869117108844928:12345-192.168.202.50@tcp:101:lsof.0 00010000:00010000:0.0:1782529248.589483:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529248.589504:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf8f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529248.589713:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529248.589739:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529248.589754:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529248.591120:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782529248.591131:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529248.592462:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529248.592795:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529248.592957:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529248.592967:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:0.0:1782529248.592970:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782529248.592973:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170a00, rc 0) 00000100:00100000:0.0:1782529248.594972:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+6:11014:x1869117108844928:12345-192.168.202.50@tcp:101:lsof.0 Request processed in 5500us (8268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529248.595155:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 136 00010000:00010000:3.0:1782529248.711158:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782529248.775248:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529248.775258:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529248.775582:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1782529248.775590:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782529248.839311:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117240960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529248.839394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529248.839540:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117240960 00000100:00100000:2.0:1782529248.839548:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117240960 00000100:00100000:2.0:1782529248.839616:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782529248.839625:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117240960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529248.839666:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529248.839712:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117240960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529248.839749:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782529248.839899:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117240960:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782529248.840268:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782529249.735489:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782529249.968659:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1782529249.968681:0:5816:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1782529249.968974:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1782529249.969056:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1782529250.759467:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529251.399278:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c66002aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117241216:0@lo:400:kworker.0 00000100:00100000:0.0:1782529251.399350:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529251.399407:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117241728:0@lo:400:kworker.0 00000100:00100000:0.0:1782529251.399432:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529251.399460:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529251.399465:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c66002a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117241344:0@lo:400:kworker.0 00000100:00100000:0.0:1782529251.399485:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529251.399520:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117241728 00000100:00100000:0.0:1782529251.399527:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117241728 00000100:00100000:0.0:1782529251.399575:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782529251.399584:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117241728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529251.399650:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117241728:12345-0@lo:400:kworker.0 Request processed in 67us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529251.399657:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782529251.399682:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117241216 00000100:00100000:0.0:1782529251.399685:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117241216 00000100:00100000:0.0:1782529251.399716:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117241344 00000100:00100000:0.0:1782529251.399719:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117241344 00000100:00100000:3.0:1782529251.399828:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c66002b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117241472:0@lo:400:kworker.0 00000100:00100000:3.0:1782529251.399884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529251.399909:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782529251.399915:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117241856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529251.399919:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117241088:0@lo:400:kworker.0 00000100:00100000:3.0:1782529251.399951:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529251.399970:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529251.400041:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782529251.400051:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117241216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529251.400954:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782529251.400969:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117241344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529251.407284:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117241600:0@lo:400:kworker.0 00000100:00100000:2.0:1782529251.424099:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117241216:12345-0@lo:400:kworker.0 Request processed in 24038us (24736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529251.424116:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782529251.424211:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117241472 00000100:00100000:2.0:1782529251.424220:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117241472 00000100:00100000:2.0:1782529251.424271:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782529251.424280:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117241472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529251.425472:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117241472:12345-0@lo:400:kworker.0 Request processed in 1187us (25581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529251.425485:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1782529251.425515:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782529251.425520:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782529251.425523:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529251.425557:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117241088 00000100:00100000:2.0:1782529251.425563:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117241088 00000100:00100000:2.0:1782529251.425600:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1782529251.425608:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3296:x1869117117241088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529251.425645:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3296:x1869117117241088:12345-0@lo:400:kworker.0 Request processed in 38us (25694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529251.425651:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1782529251.425691:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117241856 00000100:00100000:2.0:1782529251.425695:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117241856 00000100:00100000:2.0:1782529251.425732:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782529251.425738:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117241856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529251.425767:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529251.426465:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117241856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (25832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529251.426477:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782529251.426567:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c66002aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117241216:0@lo:400:kworker.0 00000100:00100000:2.0:1782529251.426583:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117241728:0@lo:400:kworker.0 00000100:00100000:0.0:1782529251.431341:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117241344:12345-0@lo:400:kworker.0 Request processed in 30368us (31845us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529251.431366:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782529251.431638:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c66002a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117241344:0@lo:400:kworker.0 00000100:00100000:3.0:1782529251.437931:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529251.438071:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117241856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529251.438110:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117241600 00000100:00100000:2.0:1782529251.438119:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117241600 00000100:00100000:2.0:1782529251.438201:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782529251.438212:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117241600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529251.438271:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117241600:12345-0@lo:400:kworker.0 Request processed in 61us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529251.438280:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1782529251.438418:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529251.438645:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117241600:0@lo:400:kworker.0 00000100:00100000:3.0:1782529251.438658:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c66002b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117241472:0@lo:400:kworker.0 00000100:00100000:3.0:1782529251.438695:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:adf301ee-99ae-4756-993e-d61f1989f0b8:3296:1869117117241088:0@lo:400:kworker.0 00010000:00010000:2.0:1782529251.783444:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529252.812526:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782529252.902127:0:12172:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:00:51 (1782529251) 00000100:00100000:3.0:1782529253.199717:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529253.199878:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108845056 00000100:00100000:1.0:1782529253.199888:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108845056 00000100:00100000:1.0:1782529253.199949:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 293 00000100:00100000:1.0:1782529253.199959:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108845056:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529253.200030:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108845056:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529253.200037:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 293 00000100:00100000:1.0:1782529253.206881:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529253.206922:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529253.206952:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108845184 00000100:00100000:2.0:1782529253.206963:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108845184 00000100:00100000:2.0:1782529253.207039:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:2.0:1782529253.207050:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:2343:x1869117108845184:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529253.207123:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:2343:x1869117108845184:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529253.207131:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:0.0:1782529253.207188:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108845440 00000100:00100000:0.0:1782529253.207193:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108845440 00000100:00100000:0.0:1782529253.207231:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:0.0:1782529253.207238:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108845440:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529253.207265:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108845440:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529253.207271:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00080000:3.0:1782529253.207407:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782529253.207413:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529253.219028:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529253.219075:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529253.219159:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108845568 00000100:00100000:3.0:1782529253.219168:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108845568 00000100:00100000:3.0:1782529253.219246:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 149 00000100:00100000:3.0:1782529253.219255:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+6:2344:x1869117108845568:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529253.219343:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+6:2344:x1869117108845568:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529253.219351:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 149 00000100:00100000:2.0:1782529253.219635:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108845312 00000100:00100000:2.0:1782529253.219640:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108845312 00000100:00100000:2.0:1782529253.219678:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:2.0:1782529253.219701:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108845312:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529253.219745:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108845312:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 46us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529253.219749:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00080000:0.0:1782529253.219798:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782529253.219802:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782529253.831219:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529253.960915:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117241984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529253.961000:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529253.961195:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117241984 00000100:00100000:1.0:1782529253.961204:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117241984 00000100:00100000:1.0:1782529253.961279:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782529253.961290:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117241984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782529253.961355:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529253.961418:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117241984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529253.961425:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782529253.961531:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117241984:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782529253.961946:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529254.799658:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529254.799733:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108845824 00000100:00100000:2.0:1782529254.799755:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108845824 00000100:00100000:2.0:1782529254.799884:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:2.0:1782529254.799895:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:11279:x1869117108845824:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782529254.799922:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529254.799941:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac47e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf96 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800007:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800020:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800030:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800042:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800048:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800054:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800697:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac493 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800708:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.800715:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529254.800733:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1782529254.801720:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.801732:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.801739:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.801745:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529254.801749:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.801755:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.801769:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99c643b34c00) 00010000:00010000:2.0:1782529254.801772:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529254.801777:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.801783:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac485 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.801795:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.801802:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.803155:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.803171:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529254.803177:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.803185:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.803198:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99c669568d00) 00010000:00010000:2.0:1782529254.803201:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529254.803205:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.803211:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac48c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.803709:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac47e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf96 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.803727:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac493 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf96 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.803735:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:2.0:1782529254.803737:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529254.803740:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01c00, rc 0) 00000100:00100000:2.0:1782529254.803798:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:11279:x1869117108845824:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 3904us (4150us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1782529254.803815:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:3.0:1782529254.812541:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529254.812642:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108845952 00000100:00100000:2.0:1782529254.812653:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108845952 00000100:00100000:2.0:1782529254.812726:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 138 00000100:00100000:2.0:1782529254.812737:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:11279:x1869117108845952:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782529254.812889:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:11279:x1869117108845952:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529254.812897:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 138 00000100:00100000:3.0:1782529254.819997:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529254.820302:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108846080 00000100:00100000:2.0:1782529254.820312:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108846080 00000100:00100000:2.0:1782529254.820379:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1782529254.820388:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:2343:x1869117108846080:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529254.820404:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529254.820429:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac493 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf96 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529254.820447:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:2.0:1782529254.820452:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529254.820512:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:2343:x1869117108846080:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 124us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529254.820520:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00010000:00010000:3.0:1782529254.855706:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782529254.924907:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529254.924917:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529254.924952:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1782529254.924959:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1782529255.060590:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1782529255.879158:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529256.523725:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782529256.523753:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117242112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529256.523829:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529256.524006:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117242112 00000100:00100000:2.0:1782529256.524014:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117242112 00000100:00100000:2.0:1782529256.524076:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782529256.524086:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117242112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529256.524124:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529256.524171:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117242112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529256.524178:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1782529256.524200:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529256.524240:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117242112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529256.527591:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67868a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117242240:0@lo:400:kworker.0 00000100:00100000:2.0:1782529256.527675:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529256.527724:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c66002a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117242752:0@lo:400:kworker.0 00000100:00100000:2.0:1782529256.527749:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529256.527782:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529256.527787:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117242752 00000100:00100000:2.0:1782529256.527788:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117242368:0@lo:400:kworker.0 00000100:00100000:0.0:1782529256.527794:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117242752 00000100:00100000:2.0:1782529256.527813:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529256.527899:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117242624:0@lo:400:kworker.0 00000100:00100000:3.0:1782529256.527931:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529256.528021:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117242240 00000100:00100000:2.0:1782529256.528026:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117242240 00000100:00100000:3.0:1782529256.528210:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529256.528217:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c66002b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117242496:0@lo:400:kworker.0 00000100:00100000:3.0:1782529256.528242:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529256.528409:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117242368 00000100:00100000:1.0:1782529256.528414:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117242368 00000100:00100000:1.0:1782529256.528451:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117242624 00000100:00100000:1.0:1782529256.528454:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117242624 00000100:00100000:1.0:1782529256.528470:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117242496 00000100:00100000:1.0:1782529256.528472:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117242496 00000100:00100000:1.0:1782529256.528488:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782529256.528496:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117242368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529256.528564:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117242368:12345-0@lo:400:kworker.0 Request processed in 60us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529256.528572:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782529256.528593:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782529256.528599:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117242624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529256.528627:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117242624:12345-0@lo:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529256.528634:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782529256.528645:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782529256.528651:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117242496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529256.528685:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117242496:12345-0@lo:400:kworker.0 Request processed in 34us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529256.528858:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c66002b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117242496:0@lo:400:kworker.0 00000100:00100000:3.0:1782529256.528870:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117242624:0@lo:400:kworker.0 00000100:00100000:1.0:1782529256.529012:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782529256.529147:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1782529256.529158:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117242240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529256.529196:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117242240:12345-0@lo:400:kworker.0 Request processed in 41us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529256.529202:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1782529256.529246:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117242368:0@lo:400:kworker.0 00000100:00100000:2.0:1782529256.529264:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67868a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117242240:0@lo:400:kworker.0 00000100:00100000:0.0:1782529256.530985:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782529256.531002:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117242752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529256.531085:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117242752:12345-0@lo:400:kworker.0 Request processed in 89us (3334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529256.531093:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1782529256.531120:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782529256.531125:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529256.531159:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c66002a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117242752:0@lo:400:kworker.0 00010000:00010000:2.0:1782529256.915065:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529256.975483:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529256.975677:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108846208 00000100:00100000:0.0:1782529256.975687:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108846208 00000100:00100000:0.0:1782529256.975782:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00100000:0.0:1782529256.975793:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:11322:x1869117108846208:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529256.975815:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529256.975860:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac4a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adf9d expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.975924:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.975938:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.975949:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.975964:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.975970:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.975977:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976284:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976293:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976300:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976315:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529256.976319:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976327:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976340:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:0.0:1782529256.976344:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529256.976349:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976355:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac4a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976368:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976375:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976381:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976386:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529256.976389:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976395:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976414:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99c642b0fb00) 00010000:00010000:0.0:1782529256.976416:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529256.976419:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976425:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac4af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976457:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac4a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf9d expref: 14 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976467:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:0.0:1782529256.976469:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529256.976473:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac4a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf9d expref: 14 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529256.976483:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:0.0:1782529256.976538:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:11322:x1869117108846208:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 747us (1063us total) trans 0 rc 301/301 00000100:00100000:0.0:1782529256.976545:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00080000:2.0:1782529256.976687:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529256.988086:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529256.988244:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108846464 00000100:00100000:1.0:1782529256.988254:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108846464 00000100:00100000:1.0:1782529256.988323:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 140 00000100:00100000:1.0:1782529256.988333:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:11322:x1869117108846464:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:1.0:1782529256.988391:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529256.988419:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eabe1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addd6 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.988436:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:1.0:1782529256.988455:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782529256.988736:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.988750:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 5 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.988758:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.988792:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 5 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.988804:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 5 pid: 5795 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529256.988818:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117242880:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529256.988931:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6461b0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529256.991896:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529256.991973:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108846592 00000100:00100000:2.0:1782529256.991983:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108846592 00010000:00010000:2.0:1782529256.992038:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 6 pid: 5795 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529256.992074:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:2.0:1782529256.992084:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0893e068-92fc-4766-84ad-86afc0006669+6:2343:x1869117108846592:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529256.992097:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529256.992104:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 6 pid: 5795 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529256.992117:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 6 pid: 5795 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529256.992137:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:2.0:1782529256.992142:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529256.992151:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529256.992159:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529256.992175:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529256.992240:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0893e068-92fc-4766-84ad-86afc0006669+6:2343:x1869117108846592:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 158us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529256.992248:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00080000:3.0:1782529256.992307:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782529256.993293:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf8f expref: 5 pid: 5795 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529256.993331:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117242880:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529256.993353:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.993362:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.993368:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.993392:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.993403:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.993412:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529256.995706:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782529256.995724:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.995733:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.995740:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.995746:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529256.995756:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.995762:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.995777:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9000) 00010000:00010000:1.0:1782529256.995780:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529256.995784:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529256.995790:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac4b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782529256.995807:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba99fc2e reply state 000000001eef8f59 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529256.995816:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782529256.995930:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:11322:x1869117108846464:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 7595us (7853us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1782529256.995939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 140 00010000:00010000:0.0:1782529257.010907:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.010927:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.010935:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.010964:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529257.010970:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.010979:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.010997:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99c643b34400) 00010000:00010000:0.0:1782529257.011001:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529257.011006:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.011011:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac4bd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529257.154800:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529257.154863:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108846720 00000100:00100000:3.0:1782529257.154873:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108846720 00000100:00100000:3.0:1782529257.154924:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:3.0:1782529257.154934:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:11330:x1869117108846720:12345-192.168.202.50@tcp:101:lctl.0 00010000:00010000:3.0:1782529257.154958:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529257.154981:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac4c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfa4 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.155047:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac4cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.155060:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac4cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.155072:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac4cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529257.155133:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782529257.155137:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782529257.155162:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac4cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.155184:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac4c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfa4 expref: 15 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.156949:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac4cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfa4 expref: 14 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.156961:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:3.0:1782529257.156964:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782529257.156967:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972be00, rc 0) 00000100:00100000:3.0:1782529257.157036:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:11330:x1869117108846720:12345-192.168.202.50@tcp:101:lctl.0 Request processed in 2102us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529257.157045:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:1.0:1782529257.222575:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.222733:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108846848 00000100:00100000:2.0:1782529257.222743:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108846848 00000100:00100000:2.0:1782529257.222806:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:2.0:1782529257.222816:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+14:11336:x1869117108846848:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529257.222875:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529257.222897:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac4d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfab expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.222962:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.222976:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.222987:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223001:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223007:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223013:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223173:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac4e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223210:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223218:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529257.223253:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1782529257.223257:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529257.223292:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223305:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223311:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223318:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223324:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529257.223327:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223335:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223346:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:2.0:1782529257.223349:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529257.223353:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223369:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac4d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223383:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223389:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223395:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223400:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529257.223403:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223409:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223416:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99c669568000) 00010000:00010000:2.0:1782529257.223419:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529257.223422:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223429:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac4e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223458:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac4d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfab expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223472:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac4e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfab expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.223484:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:2.0:1782529257.223487:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782529257.223489:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00800, rc 0) 00000100:00100000:2.0:1782529257.223873:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:11336:x1869117108846848:12345-192.168.202.50@tcp:101:bash.0 Request processed in 1058us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529257.223882:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:0.0:1782529257.229042:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529257.229134:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108847104 00000100:00100000:3.0:1782529257.229144:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108847104 00000100:00100000:3.0:1782529257.229214:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:3.0:1782529257.229225:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+15:11336:x1869117108847104:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1782529257.229246:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529257.229279:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac4ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfb2 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.229416:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.229431:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.229443:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.229480:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.229503:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.229509:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782529257.230119:0:6616:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1782529257.230310:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230320:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230327:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230360:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230367:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230374:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230381:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ac00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529257.230385:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230393:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230416:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:3.0:1782529257.230418:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529257.230423:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230429:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac4f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782529257.230441:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035c0c342 reply state 0000000089e028c8 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529257.230451:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782529257.230483:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac4ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 18 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230497:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 17 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.230503:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9a00) 00010000:00010000:3.0:1782529257.230505:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529257.230508:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:3.0:1782529257.230576:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11336:x1869117108847104:12345-192.168.202.50@tcp:101:bash.0 Request processed in 1353us (1548us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1782529257.230585:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 143 00010000:00010000:2.0:1782529257.233130:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.233147:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.233154:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.233161:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972bc00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529257.233166:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.233173:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.233188:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c6601f9600) 00010000:00010000:2.0:1782529257.233191:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529257.233205:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.233211:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac4fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529257.237241:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.237325:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108847232 00000100:00100000:2.0:1782529257.237334:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108847232 00000100:00100000:2.0:1782529257.237411:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1782529257.237422:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2341:x1869117108847232:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529257.237440:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529257.237460:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfb9 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529257.237487:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782529257.237506:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1782529257.237510:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529257.237520:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.237538:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.237551:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00200, rc 0) 00000100:00100000:2.0:1782529257.237603:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2341:x1869117108847232:12345-192.168.202.50@tcp:101:bash.0 Request processed in 183us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529257.237610:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00080000:0.0:1782529257.237745:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529257.241580:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529257.241939:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108847360 00000100:00100000:0.0:1782529257.241949:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108847360 00000100:00100000:0.0:1782529257.242039:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:0.0:1782529257.242050:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:11336:x1869117108847360:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1782529257.242068:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529257.242087:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfc0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.242117:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.242143:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529257.242147:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529257.242152:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.242187:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.242212:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 7 pid: 6593 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529257.242227:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6591:1869117117243008:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529257.242318:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7180 going to sleep for 11 seconds 00000100:00100000:2.0:1782529257.245225:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529257.245423:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108847488 00000100:00100000:3.0:1782529257.245432:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108847488 00010000:00010000:3.0:1782529257.245470:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 8 pid: 6593 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529257.245522:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:3.0:1782529257.245531:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108847488:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529257.245545:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529257.245565:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 8 pid: 6593 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.245578:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 8 pid: 6593 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.245612:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529257.245617:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529257.245625:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.245633:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.245676:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529257.245690:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c68000a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5779:1869117117243136:192.168.202.50@tcp:105: 00000100:00100000:3.0:1782529257.245754:0:5779:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6460669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529257.248088:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c68000a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5779:1869117117243136:192.168.202.50@tcp:105: 00010000:00010000:3.0:1782529257.248133:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529257.248201:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108847488:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 2661us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529257.248213:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00010000:00010000:0.0:1782529257.248590:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac511 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb9 expref: 7 pid: 6593 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529257.248617:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6591:1869117117243008:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529257.248639:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.248661:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170400, rc 0) 00000100:00100000:0.0:1782529257.248699:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:11336:x1869117108847360:12345-192.168.202.50@tcp:101:bash.0 Request processed in 6652us (7129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529257.248715:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:2.0:1782529257.252292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529257.252553:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108847744 00000100:00100000:1.0:1782529257.252563:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108847744 00000100:00100000:1.0:1782529257.252620:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:1.0:1782529257.252631:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:11336:x1869117108847744:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:1.0:1782529257.253008:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11336:x1869117108847744:12345-192.168.202.50@tcp:35:bash.0 Request processed in 378us (722us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1782529257.253017:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:3.0:1782529257.354946:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.355053:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108848000 00000100:00100000:2.0:1782529257.355064:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108848000 00000100:00100000:2.0:1782529257.355145:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:2.0:1782529257.355155:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c68000a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11346:x1869117108848000:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529257.355178:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529257.355197:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac51f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfc7 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529257.355323:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782529257.355441:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac51f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc7 expref: 20 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.355457:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:2.0:1782529257.355459:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782529257.355464:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac51f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc7 expref: 20 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.355480:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529257.355549:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c68000a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:11346:x1869117108848000:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 396us (612us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1782529257.355555:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:3.0:1782529257.359741:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529257.359917:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108848256 00000100:00100000:1.0:1782529257.359938:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108848256 00000100:00100000:1.0:1782529257.359999:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:1.0:1782529257.360009:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:11346:x1869117108848256:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529257.360256:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11346:x1869117108848256:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 247us (525us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1782529257.360274:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:0.0:1782529257.460271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529257.460445:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108848384 00000100:00100000:3.0:1782529257.460455:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108848384 00000100:00100000:3.0:1782529257.460509:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 145 00000100:00100000:3.0:1782529257.460517:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11352:x1869117108848384:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1782529257.460541:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529257.460559:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac52d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfce expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.460632:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.460645:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.460685:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529257.460739:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1782529257.460742:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782529257.460760:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.460781:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac52d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfce expref: 22 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.460816:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfce expref: 21 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.460825:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:3.0:1782529257.460828:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782529257.460875:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045000, rc 0) 00000100:00100000:3.0:1782529257.461076:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:11352:x1869117108848384:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 558us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529257.461083:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 145 00000100:00100000:3.0:1782529257.467446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529257.467788:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108848640 00000100:00100000:0.0:1782529257.467799:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108848640 00000100:00100000:0.0:1782529257.467885:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 146 00000100:00100000:0.0:1782529257.467896:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:11352:x1869117108848640:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529257.467917:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529257.467936:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac53b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfd5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.468038:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.468051:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.468062:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529257.468073:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782529257.468193:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac53b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfd5 expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.468210:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfd5 expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.468219:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9a00) 00010000:00010000:0.0:1782529257.468222:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529257.468237:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:0.0:1782529257.468316:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:11352:x1869117108848640:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 422us (880us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1782529257.468324:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 146 00000100:00100000:1.0:1782529257.472593:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529257.472660:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.472748:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108849024 00000100:00100000:2.0:1782529257.472758:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108849024 00000100:00100000:2.0:1782529257.472828:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:2.0:1782529257.472869:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:2341:x1869117108849024:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529257.472884:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529257.472908:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfd5 expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.472946:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9a00) 00010000:00010000:2.0:1782529257.472951:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529257.472998:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:2341:x1869117108849024:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 130us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529257.473005:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1782529257.473212:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108848896 00000100:00100000:0.0:1782529257.473217:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108848896 00000100:00100000:0.0:1782529257.473255:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 147 00000100:00100000:0.0:1782529257.473267:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:11352:x1869117108848896:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529257.473287:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529257.473311:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfdc expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.473401:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac557 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.473414:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.473423:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529257.473434:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782529257.473559:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfdc expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.473575:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfdc expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.473583:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9a00) 00010000:00010000:0.0:1782529257.473592:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782529257.473595:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030200, rc 0) 00000100:00100000:0.0:1782529257.473639:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:11352:x1869117108848896:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 377us (1055us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1782529257.473646:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 147 00000100:00100000:1.0:1782529257.482179:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.482416:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108849152 00000100:00100000:2.0:1782529257.482428:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108849152 00000100:00100000:2.0:1782529257.482490:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:2.0:1782529257.482501:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108849152:12345-192.168.202.50@tcp:1:lfs.0 00010000:00010000:2.0:1782529257.482557:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.482577:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.482586:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529257.482590:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529257.482595:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.482631:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.482645:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 6 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529257.482697:0:6593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660029180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1869117117243264:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529257.482802:0:6593:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6584e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1782529257.487381:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529257.487501:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108849280 00000100:00100000:3.0:1782529257.487512:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108849280 00002000:00100000:3.0:1782529257.487563:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99c67b0c7b80 x1869117108849280/t0(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:693/0 lens 504/0 e 0 to 0 dl 1782529268 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529257.487574:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67b0c7b80 with x1869117108849280 ext(0->12) 00010000:00010000:3.0:1782529257.487582:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 7 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529257.487599:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 7 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782529257.487606:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99c67b0c7b80 00000100:00100000:3.0:1782529257.487638:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1782529257.487647:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108849280:12345-192.168.202.50@tcp:4:lfs.0 00000100:00100000:2.0:1782529257.488388:0:6593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660029180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1869117117243264:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529257.488418:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529257.490053:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108849280:12345-192.168.202.50@tcp:4:lfs.0 Request processed in 2395us (2671us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782529257.490067:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00002000:00100000:2.0:1782529257.490083:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99c67b0c7b80 x1869117108849280/t4294967305(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:693/0 lens 504/448 e 0 to 0 dl 1782529268 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782529257.490094:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67b0c7b80 with x1869117108849280 ext(0->12) 00010000:00010000:2.0:1782529257.490104:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 9 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.490125:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 9 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529257.490132:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99c67b0c7b80 00000100:00100000:1.0:1782529257.494039:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.494462:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108849408 00000100:00100000:2.0:1782529257.494716:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108849408 00010000:00010000:2.0:1782529257.494761:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 9 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529257.494947:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:2.0:1782529257.494958:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108849408:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529257.494977:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782529257.494997:0:5780:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782529257.495000:0:5780:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782529257 00002000:00010000:2.0:1782529257.495002:0:5780:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782529257 00002000:00010000:2.0:1782529257.495004:0:5780:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782529257 00010000:00010000:2.0:1782529257.495010:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 9 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.495023:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 9 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.495046:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028e8e774/0x72bfdc08f7eac518 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfc0 expref: 9 pid: 6591 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.495064:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529257.495067:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529257.495073:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.495082:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.495162:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529257.495289:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108849408:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 332us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529257.495298:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00010000:00010000:0.0:1782529257.495685:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.495697:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.495722:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.495730:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.495737:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.495744:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529257.495748:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.495756:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.495781:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.495789:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001421fc5c/0x72bfdc08f7eac565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529257.495893:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108849152:12345-192.168.202.50@tcp:1:lfs.0 Request processed in 13393us (13722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529257.495900:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1782529257.499172:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529257.499441:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108849664 00000100:00100000:1.0:1782529257.499452:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108849664 00000100:00100000:1.0:1782529257.499516:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:1.0:1782529257.499526:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:11352:x1869117108849664:12345-192.168.202.50@tcp:35:lfs.0 00000004:00010000:1.0:1782529257.499593:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfdc expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782529257.499990:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1782529257.500034:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1782529257.501012:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1782529257.501080:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.501099:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 28 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.501110:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.501151:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 28 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.501166:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 28 pid: 6616 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529257.501180:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1869117117243392:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529257.501581:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6461b0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529257.504414:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1869117117243392:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529257.504445:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529257.505880:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.506024:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108849792 00000100:00100000:2.0:1782529257.506036:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108849792 00010000:00010000:2.0:1782529257.506081:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 29 pid: 6616 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529257.506132:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:2.0:1782529257.506143:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650287450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:2343:x1869117108849792:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529257.506159:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529257.506166:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 29 pid: 6616 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.506178:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 29 pid: 6616 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.506212:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfb2 expref: 29 pid: 6616 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.506233:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9a00) 00010000:00010000:2.0:1782529257.506240:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.506249:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.506257:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529257.506308:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529257.506377:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650287450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:2343:x1869117108849792:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 234us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529257.506384:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00010000:00010000:0.0:1782529257.506501:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.506510:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782529257.506641:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1782529257.506908:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1782529257.507024:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117243520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782529257.507127:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529257.507160:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67f875b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782529257.507554:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117243520 00000100:00100000:2.0:1782529257.507561:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117243520 00000100:00100000:2.0:1782529257.507600:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782529257.507609:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1869117117243520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782529257.507700:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1869117117243520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529257.507707:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782529257.508439:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117243520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782529257.509080:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1782529257.509180:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c88e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117243648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782529257.509561:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529257.509716:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117243648 00000100:00100000:2.0:1782529257.509724:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117243648 00000100:00100000:2.0:1782529257.509789:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782529257.509800:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1869117117243648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782529257.510006:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1869117117243648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 209us (446us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782529257.510015:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782529257.510574:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c650270900 going to sleep for 11 seconds 00000100:00100000:0.0:1782529257.510724:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c88e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117243648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782529257.510804:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1782529257.511106:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.511117:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.511124:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.511130:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529257.511135:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.511142:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.511159:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9a00) 00010000:00010000:0.0:1782529257.511162:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782529257.511167:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.511173:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac56c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782529257.511564:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782529257.511827:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1782529257.512744:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319424909331ns, next at 320424906079ns, rc = 0 00000001:00080000:0.0:1782529257.512756:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1782529257.512815:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9a00) 00010000:00010000:0.0:1782529257.512819:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782529257.512829:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac557 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfdc expref: 32 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529257.513098:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:11352:x1869117108849664:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 13572us (13934us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1782529257.513109:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000020:00080000:0.0:1782529257.513115:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782529257.517184:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529257.517414:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108849920 00000100:00100000:0.0:1782529257.517425:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108849920 00000100:00100000:0.0:1782529257.517526:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:0.0:1782529257.517538:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:11352:x1869117108849920:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529257.517563:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529257.517587:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac573 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfe3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.517672:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfe3 expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.517686:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfe3 expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.517705:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:0.0:1782529257.517707:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529257.517710:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031c00, rc 0) 00000100:00100000:0.0:1782529257.517785:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:11352:x1869117108849920:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 250us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529257.517792:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:3.0:1782529257.521092:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.521336:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108850176 00000100:00100000:2.0:1782529257.521346:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108850176 00000100:00100000:2.0:1782529257.521397:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:2.0:1782529257.521407:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:11352:x1869117108850176:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1782529257.521612:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:11352:x1869117108850176:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 206us (528us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1782529257.521621:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:2.0:1782529257.629228:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529257.629380:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108850432 00000100:00100000:0.0:1782529257.629389:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108850432 00000100:00100000:0.0:1782529257.629447:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 149 00000100:00100000:0.0:1782529257.629457:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+33:11362:x1869117108850432:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529257.629480:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529257.629499:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac57a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfea expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529257.629624:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782529257.629746:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac57a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfea expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.629761:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:0.0:1782529257.629764:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529257.629769:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac57a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfea expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.629784:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030200, rc 0) 00000100:00100000:0.0:1782529257.630334:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:11362:x1869117108850432:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 877us (1112us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1782529257.630343:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 149 00000100:00100000:3.0:1782529257.634739:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529257.634872:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108850560 00000100:00100000:1.0:1782529257.634882:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108850560 00000100:00100000:1.0:1782529257.634932:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 150 00000100:00100000:1.0:1782529257.634941:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:11362:x1869117108850560:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:1.0:1782529257.635019:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635035:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635047:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635060:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635067:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635073:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635181:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635189:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635195:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782529257.635240:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635251:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635258:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635279:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635286:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529257.635290:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635299:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635312:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:1.0:1782529257.635314:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529257.635319:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635330:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac588 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635344:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635351:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635357:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635362:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529257.635365:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635370:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635378:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c643b34e00) 00010000:00010000:1.0:1782529257.635380:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529257.635382:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635387:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac58f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635401:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635407:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635418:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635423:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529257.635425:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635431:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635439:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:1.0:1782529257.635441:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529257.635444:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.635450:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529257.635512:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:11362:x1869117108850560:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 571us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529257.635520:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 150 00000100:00100000:3.0:1782529257.638880:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.638977:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108850816 00000100:00100000:2.0:1782529257.638986:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108850816 00000100:00100000:2.0:1782529257.639046:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:2.0:1782529257.639056:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:11362:x1869117108850816:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1782529257.639330:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:11362:x1869117108850816:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 274us (504us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1782529257.639338:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:2.0:1782529257.678692:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529257.678793:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108851072 00000100:00100000:0.0:1782529257.678804:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108851072 00000100:00100000:0.0:1782529257.678907:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 151 00000100:00100000:0.0:1782529257.678918:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:11365:x1869117108851072:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529257.678959:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529257.678981:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eac59d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adff1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679054:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679069:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679080:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679095:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679102:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679108:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679236:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679245:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679251:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529257.679479:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782529257.679585:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679594:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679600:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679606:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529257.679610:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679618:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679631:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529257.679633:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529257.679639:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679645:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031400/0x72bfdc08f7eac5a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679670:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679677:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679683:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679697:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529257.679700:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679707:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679715:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c642b0f300) 00010000:00010000:0.0:1782529257.679717:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529257.679720:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679726:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030200/0x72bfdc08f7eac5ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679767:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030c00/0x72bfdc08f7eac59d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679780:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529257.679787:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:0.0:1782529257.679789:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529257.679792:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170400, rc 0) 00000100:00100000:0.0:1782529257.679926:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:11365:x1869117108851072:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1009us (1243us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1782529257.679935:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 151 00000100:00100000:0.0:1782529257.688222:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529257.688382:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108851200 00000100:00100000:1.0:1782529257.688391:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108851200 00000100:00100000:1.0:1782529257.688450:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 152 00000100:00100000:1.0:1782529257.688460:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:11365:x1869117108851200:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1782529257.688528:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688545:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688562:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688590:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688597:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688611:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688617:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529257.688622:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688629:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688640:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:1.0:1782529257.688642:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782529257.688656:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529257.688663:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac5c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529257.688736:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:11365:x1869117108851200:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 277us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529257.688744:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 152 00000100:00100000:3.0:1782529257.691878:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529257.691998:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108851456 00000100:00100000:2.0:1782529257.692007:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108851456 00000100:00100000:2.0:1782529257.692063:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:2.0:1782529257.692072:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:11365:x1869117108851456:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1782529257.692316:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+38:11365:x1869117108851456:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 244us (446us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1782529257.692324:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00010000:00010000:3.0:1782529257.928407:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529258.019495:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529258.019566:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108851712 00000100:00100000:3.0:1782529258.019576:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108851712 00000100:00080000:0.0:1782529258.019661:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529258.019668:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:3.0:1782529258.019681:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+38:11396:x1869117108851712:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:3.0:1782529258.019704:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529258.019723:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac5c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adff8 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.019827:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac5ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.019875:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.019887:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529258.019900:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782529258.020044:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac5c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff8 expref: 41 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.020063:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac5ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff8 expref: 40 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.020091:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:3.0:1782529258.020094:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529258.020097:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045400, rc 0) 00000100:00100000:3.0:1782529258.020158:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:11396:x1869117108851712:12345-192.168.202.50@tcp:101:cat.0 Request processed in 481us (671us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1782529258.020166:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:0.0:1782529258.023928:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529258.024116:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108851840 00000100:00100000:2.0:1782529258.024124:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108851840 00000100:00100000:2.0:1782529258.024183:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:2.0:1782529258.024191:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:2344:x1869117108851840:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529258.024204:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529258.024225:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac5ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff8 expref: 40 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.024243:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:2.0:1782529258.024261:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529258.024313:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:2344:x1869117108851840:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 123us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529258.024321:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:2.0:1782529258.028903:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529258.032973:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108852096 00000100:00100000:1.0:1782529258.033003:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108852096 00000100:00100000:1.0:1782529258.033170:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:1.0:1782529258.033191:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:11396:x1869117108852096:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:1.0:1782529258.033609:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:11396:x1869117108852096:12345-192.168.202.50@tcp:35:cat.0 Request processed in 364us (4651us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1782529258.033618:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:1.0:1782529258.114128:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529258.114210:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108852352 00000100:00100000:3.0:1782529258.114219:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108852352 00000100:00100000:3.0:1782529258.114276:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:3.0:1782529258.114284:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:11402:x1869117108852352:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:3.0:1782529258.114305:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529258.114308:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782529258.114330:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfce expref: 40 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.114346:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:3.0:1782529258.114349:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529258.114357:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac5dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0adfff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.114436:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.114445:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.114465:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.114490:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.114499:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 40 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529258.114509:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117243776:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529258.114582:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646066000 going to sleep for 11 seconds 00000100:00100000:1.0:1782529258.117566:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117243776:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529258.117595:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529258.117744:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529258.117819:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108852480 00000100:00100000:2.0:1782529258.117827:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108852480 00010000:00010000:2.0:1782529258.117889:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 41 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529258.117921:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:2.0:1782529258.117929:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+41:2344:x1869117108852480:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529258.117942:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529258.117948:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 41 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.117959:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 41 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.117980:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac5b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adff1 expref: 41 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.117994:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:2.0:1782529258.117999:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.118009:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.118032:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.118060:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529258.118165:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:2344:x1869117108852480:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 236us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529258.118172:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00010000:00010000:1.0:1782529258.118280:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.118288:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529258.118306:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782529258.118444:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac5dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.118459:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.118466:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:1.0:1782529258.118468:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782529258.118470:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045600, rc 0) 00000100:00100000:1.0:1782529258.118493:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:11402:x1869117108852352:12345-192.168.202.50@tcp:101:dd.0 Request processed in 4209us (4372us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1782529258.118505:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:2.0:1782529258.134548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529258.134625:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108852736 00000100:00100000:3.0:1782529258.134636:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108852736 00000100:00100000:3.0:1782529258.134703:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 155 00000100:00100000:3.0:1782529258.134713:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:11402:x1869117108852736:12345-192.168.202.50@tcp:36:dd.0 00010000:00010000:3.0:1782529258.135104:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.135122:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.135134:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782529258.135182:0:6616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1782529258.135206:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a52fdf4 reply state 000000004f8366d0 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529258.135231:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529258.138102:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:11402:x1869117108852736:12345-192.168.202.50@tcp:36:dd.0 Request processed in 3379us (3554us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1782529258.138114:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 155 00000020:00080000:2.0:1782529258.138120:0:6616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782529258.155391:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.155409:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.155417:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.155423:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529258.155428:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.155435:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.155453:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:1.0:1782529258.155456:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529258.155462:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.155468:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac5f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529258.333900:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529258.333947:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529258.333980:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529258.334021:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108852864 00000100:00100000:3.0:1782529258.334033:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108852864 00000100:00100000:1.0:1782529258.334070:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108852992 00000100:00100000:1.0:1782529258.334076:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108852992 00000100:00100000:3.0:1782529258.334098:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 295 00000100:00100000:3.0:1782529258.334112:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108852864:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529258.334122:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:1.0:1782529258.334132:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108852992:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529258.334197:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108852992:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 67us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529258.334219:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00080000:0.0:1782529258.334299:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529258.334313:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108853120 00000100:00100000:0.0:1782529258.334316:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108853120 00000100:00100000:0.0:1782529258.334355:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:0.0:1782529258.334360:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108853120:12345-192.168.202.50@tcp:400:kworker.0 00000100:00080000:1.0:1782529258.334406:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529258.334534:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108852864:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 425us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529258.334812:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 295 00000100:00100000:0.0:1782529258.339027:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108853120:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 4651us (5032us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529258.339046:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:2.0:1782529258.455089:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529258.455194:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108853248 00000100:00100000:1.0:1782529258.455203:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108853248 00000100:00100000:1.0:1782529258.455268:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 156 00000100:00100000:1.0:1782529258.455277:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+42:11416:x1869117108853248:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:1.0:1782529258.455301:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529258.455318:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac5f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae006 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455380:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455393:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455403:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455416:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455423:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455428:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455518:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455545:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455554:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455584:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.455598:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 43 pid: 5794 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529258.455613:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117243904:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529258.455727:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6461b0900 going to sleep for 11 seconds 00000100:00100000:1.0:1782529258.461008:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529258.461087:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108853504 00000100:00100000:3.0:1782529258.461095:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108853504 00000100:00100000:3.0:1782529258.461162:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:3.0:1782529258.461171:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+44:5558:x1869117108853504:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782529258.461485:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:5558:x1869117108853504:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 314us (486us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1782529258.461493:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:0.0:1782529258.462520:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117243904:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529258.462545:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529258.463893:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529258.464241:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108853632 00000100:00100000:2.0:1782529258.464250:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108853632 00010000:00010000:2.0:1782529258.464285:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 45 pid: 5794 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529258.464325:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:2.0:1782529258.464333:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:2344:x1869117108853632:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529258.464348:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529258.464355:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 45 pid: 5794 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.464385:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 45 pid: 5794 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.464404:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eac5e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfff expref: 45 pid: 5794 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.464420:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:2.0:1782529258.464425:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.464434:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.464441:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.464466:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529258.464525:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+44:2344:x1869117108853632:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 192us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529258.464533:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00010000:00010000:0.0:1782529258.465354:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465365:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529258.465407:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782529258.465411:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529258.465434:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465447:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465457:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465476:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465482:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465488:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529258.465492:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465499:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465509:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529258.465512:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529258.465515:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465522:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac5ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465533:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465540:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465547:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465552:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529258.465573:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465581:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465590:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c643b34e00) 00010000:00010000:0.0:1782529258.465592:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529258.465595:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465601:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac606 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465767:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac5f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae006 expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465783:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae006 expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.465792:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:0.0:1782529258.465794:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529258.465796:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7600, rc 0) 00000100:00100000:0.0:1782529258.465873:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:11416:x1869117108853248:12345-192.168.202.50@tcp:101:stat.0 Request processed in 10596us (10793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529258.465882:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 156 00000100:00100000:3.0:1782529258.558110:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529258.558374:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108853888 00000100:00100000:1.0:1782529258.558385:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108853888 00000100:00100000:1.0:1782529258.558586:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 157 00000100:00100000:1.0:1782529258.558597:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:11422:x1869117108853888:12345-192.168.202.50@tcp:36:truncate.0 00010000:00010000:1.0:1782529258.558674:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529258.558702:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac60d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae006 expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.558722:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:1.0:1782529258.558727:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782529258.558997:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.559023:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.559032:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782529258.559082:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1782529258.559107:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0c5c887 reply state 00000000a95f30e2 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529258.559116:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782529258.559804:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:11422:x1869117108853888:12345-192.168.202.50@tcp:36:truncate.0 Request processed in 1206us (1700us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1782529258.559812:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 157 00000020:00080000:1.0:1782529258.559818:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782529258.562073:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.562090:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.562096:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.562102:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529258.562120:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.562128:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.562212:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:3.0:1782529258.562215:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529258.562220:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.562227:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac614 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529258.737411:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529258.740109:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108854016 00000100:00100000:2.0:1782529258.740125:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108854016 00000100:00100000:2.0:1782529258.740216:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 158 00000100:00100000:2.0:1782529258.740226:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+44:11436:x1869117108854016:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:2.0:1782529258.740251:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529258.740460:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac61b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae00d expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.740633:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.740726:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.740740:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.740875:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.740884:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.740891:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.742873:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.742891:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.742901:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529258.742949:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1782529258.742954:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529258.744101:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.744130:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.745062:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.745072:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.745079:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.745084:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529258.745089:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.745097:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.745113:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:2.0:1782529258.745116:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529258.745120:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.745126:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac622 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.746064:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.746073:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.746090:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.746093:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529258.746096:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.746101:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.746108:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c669568e00) 00010000:00010000:2.0:1782529258.746110:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529258.746112:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.746116:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.747252:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac61b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 46 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.747744:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 45 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.749722:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:2.0:1782529258.749727:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529258.749732:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529258.749822:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:11436:x1869117108854016:12345-192.168.202.50@tcp:101:stat.0 Request processed in 9595us (12418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529258.749856:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 158 00000100:00100000:2.0:1782529258.863825:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529258.863979:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108854272 00000100:00100000:0.0:1782529258.863998:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108854272 00000100:00100000:0.0:1782529258.864155:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 159 00000100:00100000:0.0:1782529258.864167:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67868a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+45:11446:x1869117108854272:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529258.864205:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529258.864228:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae014 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529258.864376:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782529258.864509:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac637 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae014 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.864525:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:0.0:1782529258.864528:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529258.864533:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae014 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.864565:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170a00, rc 0) 00000100:00100000:0.0:1782529258.864656:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67868a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+46:11446:x1869117108854272:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 492us (848us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1782529258.864664:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 159 00000100:00100000:3.0:1782529258.868687:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529258.869441:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108854528 00000100:00100000:1.0:1782529258.869453:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108854528 00000100:00100000:1.0:1782529258.869757:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:1.0:1782529258.869771:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+46:11446:x1869117108854528:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529258.871236:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:11446:x1869117108854528:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 1462us (2551us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1782529258.871244:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:3.0:1782529258.951006:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529258.953334:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108854784 00000100:00100000:0.0:1782529258.953350:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108854784 00000100:00100000:0.0:1782529258.953428:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 160 00000100:00100000:0.0:1782529258.953438:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+47:11452:x1869117108854784:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1782529258.953462:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529258.953481:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac645 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae01b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.953589:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.953618:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 48 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.953626:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.953671:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 48 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.953684:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 48 pid: 6616 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529258.953697:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f19bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117244032:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529258.953805:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c648547480 going to sleep for 11 seconds 00010000:00010000:2.0:1782529258.954194:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529258.958654:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529258.958758:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108854912 00000100:00100000:3.0:1782529258.958776:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108854912 00010000:00010000:3.0:1782529258.958870:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 49 pid: 6616 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529258.958930:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:3.0:1782529258.958941:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+49:2343:x1869117108854912:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529258.958965:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529258.958973:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 49 pid: 6616 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.958988:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 49 pid: 6616 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.959052:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:3.0:1782529258.959060:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.959071:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.959080:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.959104:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529258.959201:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+49:2343:x1869117108854912:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 260us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529258.959210:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00010000:00010000:0.0:1782529258.959241:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac630 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae00d expref: 48 pid: 6616 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529258.959269:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f19bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117244032:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529258.959301:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.959311:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.959318:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529258.959340:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1782529258.959525:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac645 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.960163:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529258.960177:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:0.0:1782529258.960180:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782529258.960184:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170400, rc 0) 00000100:00100000:0.0:1782529258.960258:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+48:11452:x1869117108854784:12345-192.168.202.50@tcp:101:bash.0 Request processed in 6820us (9268us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1782529258.960267:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 160 00000100:00100000:2.0:1782529258.970188:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529258.970291:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108855168 00000100:00100000:1.0:1782529258.970302:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108855168 00000100:00100000:1.0:1782529258.970364:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:1.0:1782529258.970375:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+48:11452:x1869117108855168:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:1.0:1782529258.970671:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.970703:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.970715:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782529258.970770:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1782529258.970794:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3196ba7 reply state 0000000049908307 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529258.970803:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782529258.970940:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+51:11452:x1869117108855168:12345-192.168.202.50@tcp:36:bash.0 Request processed in 566us (761us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1782529258.970948:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 161 00000020:00080000:1.0:1782529258.970953:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782529258.972865:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.972878:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.972885:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.972891:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529258.972896:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.972903:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.972933:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:1.0:1782529258.972936:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529258.972941:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529258.972947:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac65a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529258.979880:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529258.981939:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108855296 00000100:00100000:3.0:1782529258.981953:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108855296 00000100:00100000:3.0:1782529258.982427:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 162 00000100:00100000:3.0:1782529258.982439:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:11452:x1869117108855296:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1782529258.982465:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529258.982487:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac661 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae022 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.982589:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.982604:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.982633:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.982679:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.982692:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 51 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529258.982706:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117244160:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529258.982798:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646066600 going to sleep for 11 seconds 00000100:00100000:2.0:1782529258.986340:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117244160:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529258.986371:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529258.986923:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529258.987061:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108855424 00000100:00100000:3.0:1782529258.987069:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108855424 00010000:00010000:3.0:1782529258.987110:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 52 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529258.987151:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:3.0:1782529258.987161:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:2343:x1869117108855424:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529258.987185:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529258.987193:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 52 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.987205:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 52 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.987227:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac64c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae01b expref: 52 pid: 5796 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.987264:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:3.0:1782529258.987270:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.987279:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.987287:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529258.987314:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529258.987377:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+51:2343:x1869117108855424:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 217us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529258.987385:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00010000:00010000:2.0:1782529258.988036:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.988047:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529258.988097:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782529258.988102:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529258.988122:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.988160:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae022 expref: 51 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.989074:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae022 expref: 50 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529258.989089:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:2.0:1782529258.989108:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529258.989112:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044600, rc 0) 00000100:00100000:2.0:1782529258.989173:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:11452:x1869117108855296:12345-192.168.202.50@tcp:101:bash.0 Request processed in 6735us (9337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529258.989628:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 162 00000100:00100000:3.0:1782529258.994682:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529258.994823:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108855680 00000100:00100000:1.0:1782529258.994873:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108855680 00000100:00100000:1.0:1782529258.994925:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:1.0:1782529258.994934:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:11452:x1869117108855680:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:1.0:1782529258.995186:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+51:11452:x1869117108855680:12345-192.168.202.50@tcp:35:bash.0 Request processed in 240us (502us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1782529258.995195:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000040:00080000:3.0:1782529259.016148:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529259.016158:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529259.016441:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1782529259.016455:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782529259.079144:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117244288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529259.079234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782529259.079429:0:7957:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320991594150ns, next at 321991591481ns, rc = 0 00000100:00100000:2.0:1782529259.080632:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117244288 00000100:00100000:2.0:1782529259.080655:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117244288 00000100:00100000:2.0:1782529259.080801:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782529259.080811:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869117117244288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529259.080866:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782529259.081200:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529259.087745:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869117117244288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6926us (8501us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529259.087772:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782529259.096027:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117244288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782529259.135610:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529259.146529:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108855936 00000100:00100000:0.0:1782529259.149599:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108855936 00000100:00100000:0.0:1782529259.150111:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 163 00000100:00100000:0.0:1782529259.150123:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+51:11462:x1869117108855936:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529259.150148:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529259.150168:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac66f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae029 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529259.151405:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782529259.152412:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac66f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae029 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529259.152435:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:0.0:1782529259.152438:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529259.152459:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac66f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae029 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529259.152478:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:0.0:1782529259.152650:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:11462:x1869117108855936:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 2528us (17907us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1782529259.152673:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 163 00000100:00100000:1.0:1782529259.173093:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529259.176493:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108856064 00000100:00100000:0.0:1782529259.176508:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108856064 00000100:00100000:1.0:1782529259.180163:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 164 00000100:00100000:1.0:1782529259.180179:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:11462:x1869117108856064:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:3.0:1782529259.181140:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181163:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181179:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181221:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181228:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181235:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181410:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181420:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181428:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782529259.181472:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181486:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181493:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181500:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181506:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529259.181510:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181524:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.181608:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:3.0:1782529259.181612:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529259.181617:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182108:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac67d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182127:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182134:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182140:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182146:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529259.182149:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182156:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182166:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c6601f9200) 00010000:00010000:3.0:1782529259.182169:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529259.182172:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182191:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182209:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182215:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182222:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182227:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529259.182230:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182236:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182242:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:3.0:1782529259.182244:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529259.182247:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.182253:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac68b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529259.182464:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:11462:x1869117108856064:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 2284us (9377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529259.182474:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 164 00000100:00100000:3.0:1782529259.186342:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529259.186439:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108856320 00000100:00100000:1.0:1782529259.186454:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108856320 00000100:00100000:1.0:1782529259.186585:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:1.0:1782529259.186597:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:11462:x1869117108856320:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529259.186970:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+53:11462:x1869117108856320:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 367us (632us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1782529259.186978:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:1.0:1782529259.243055:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529259.243200:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108856576 00000100:00100000:2.0:1782529259.243211:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108856576 00000100:00100000:2.0:1782529259.243272:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:2.0:1782529259.243282:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+53:11465:x1869117108856576:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529259.243306:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529259.243326:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae030 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243398:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243413:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243424:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243451:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243459:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243466:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243603:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac6a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243613:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243621:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529259.243631:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782529259.243745:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243753:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243760:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243766:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529259.243770:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243788:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243800:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:2.0:1782529259.243803:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529259.243808:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243815:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac699 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243829:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243888:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243893:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243897:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529259.243899:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243904:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243910:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c669568e00) 00010000:00010000:2.0:1782529259.243912:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529259.243915:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243929:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243980:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae030 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.243993:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae030 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.244000:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:2.0:1782529259.244002:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529259.244004:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00400, rc 0) 00000100:00100000:2.0:1782529259.244066:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11465:x1869117108856576:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 785us (1021us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1782529259.244073:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:2.0:1782529259.248729:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529259.248776:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529259.248927:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108856704 00000100:00100000:3.0:1782529259.248936:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108856704 00000100:00100000:3.0:1782529259.249001:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:3.0:1782529259.249011:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11465:x1869117108856704:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1782529259.249075:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249092:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249104:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249129:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249137:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249144:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249150:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529259.249154:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249162:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249173:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:3.0:1782529259.249176:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782529259.249196:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529259.249203:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac6b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529259.249271:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11465:x1869117108856704:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 261us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529259.249279:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:0.0:1782529259.249409:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108856832 00000100:00100000:0.0:1782529259.249414:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108856832 00000100:00100000:0.0:1782529259.249455:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:0.0:1782529259.249463:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:2344:x1869117108856832:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529259.249474:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529259.249489:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eac6a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae030 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529259.249501:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:0.0:1782529259.249504:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529259.249524:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:2344:x1869117108856832:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 62us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529259.249531:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1782529259.251951:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529259.252099:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108857088 00000100:00100000:1.0:1782529259.252109:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108857088 00000100:00100000:1.0:1782529259.252157:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:1.0:1782529259.252165:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:11465:x1869117108857088:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529259.252398:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11465:x1869117108857088:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 233us (453us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1782529259.252407:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1782529259.399147:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529259.408942:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108857344 00000100:00100000:1.0:1782529259.408956:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108857344 00000100:00100000:1.0:1782529259.409083:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 167 00000100:00100000:1.0:1782529259.409094:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11483:x1869117108857344:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:1.0:1782529259.409118:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529259.409138:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac6bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae037 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529259.409232:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac6c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529259.409245:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529259.409258:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529259.409288:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782529259.409406:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac6bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae037 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529259.409425:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac6c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae037 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529259.409434:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:1.0:1782529259.409437:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782529259.409440:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7a00, rc 0) 00000100:00100000:1.0:1782529259.409508:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11483:x1869117108857344:12345-192.168.202.50@tcp:101:cat.0 Request processed in 416us (10371us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1782529259.409516:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 167 00000100:00100000:3.0:1782529259.451108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529259.451723:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108857472 00000100:00100000:2.0:1782529259.451738:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108857472 00000100:00100000:2.0:1782529259.451826:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:2.0:1782529259.451874:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11484:x1869117108857472:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529259.451899:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529259.451919:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac6d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae03e expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.451984:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.452010:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.452022:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529259.452084:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1782529259.452088:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529259.452109:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.452135:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac6d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae03e expref: 59 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.452154:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae03e expref: 58 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.452163:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:2.0:1782529259.452166:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529259.452170:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529259.452240:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11484:x1869117108857472:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 404us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529259.452248:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:3.0:1782529259.458438:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529259.458530:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108857856 00000100:00100000:1.0:1782529259.458553:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108857856 00000100:00100000:1.0:1782529259.458623:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:1.0:1782529259.458644:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11484:x1869117108857856:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529259.459037:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11484:x1869117108857856:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 403us (624us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1782529259.459046:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:3.0:1782529259.461340:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529259.463746:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108857984 00000100:00100000:2.0:1782529259.463763:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108857984 00000100:00100000:2.0:1782529259.463882:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:2.0:1782529259.463892:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650284850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11484:x1869117108857984:12345-192.168.202.50@tcp:103:lfs.0 00010000:00010000:2.0:1782529259.463910:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782529259.463948:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae022 expref: 59 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.463972:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac6c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae037 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.463985:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640031c00/0x72bfdc08f7eac573 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfe3 expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.463997:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fb00) 00010000:00010000:2.0:1782529259.464009:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529259.464079:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650284850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:11484:x1869117108857984:12345-192.168.202.50@tcp:103:lfs.0 Request processed in 188us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529259.464087:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1782529259.467127:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529259.467222:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108858112 00000100:00100000:0.0:1782529259.467238:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108858112 00000100:00100000:0.0:1782529259.467316:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 169 00000100:00100000:0.0:1782529259.467327:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:11484:x1869117108858112:12345-192.168.202.50@tcp:58:lfs.0 00010000:00010000:0.0:1782529259.467438:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529259.467467:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529259.467479:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782529259.467685:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1782529259.467788:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:11484:x1869117108858112:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 462us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529259.467796:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 169 00000100:00100000:3.0:1782529259.502954:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529259.503136:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108858240 00000100:00100000:2.0:1782529259.503150:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108858240 00000100:00100000:2.0:1782529259.503439:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 170 00000100:00100000:2.0:1782529259.503454:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:11486:x1869117108858240:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529259.503482:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529259.503510:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac6e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae045 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503609:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503626:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503652:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503687:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503695:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503701:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503954:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503964:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.503971:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529259.504020:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782529259.504025:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529259.504049:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504063:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504073:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504079:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504102:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504108:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529259.504113:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504123:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504139:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:2.0:1782529259.504142:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529259.504148:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504154:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac6ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504171:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504177:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504183:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504189:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529259.504192:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504208:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504217:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c669568e00) 00010000:00010000:2.0:1782529259.504219:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529259.504223:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504229:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eac6f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504524:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac6e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 58 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504540:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 57 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529259.504547:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0f300) 00010000:00010000:2.0:1782529259.504549:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529259.504552:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00a00, rc 0) 00000100:00100000:2.0:1782529259.504651:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11486:x1869117108858240:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1200us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529259.504661:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 170 00010000:00010000:1.0:1782529259.975377:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782529260.046145:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529260.046156:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529260.046668:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782529260.046677:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782529260.046817:0:11551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117244416:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782529260.047439:0:11551:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c649ea4180 going to sleep for 11 seconds 00000100:00100000:3.0:1782529260.066334:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529260.066485:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108858368 00000100:00100000:0.0:1782529260.066495:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108858368 00000100:00100000:0.0:1782529260.066584:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00100000:0.0:1782529260.066595:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11497:x1869117108858368:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782529260.066641:0:5795:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782529260.066741:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11497:x1869117108858368:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 148us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529260.066749:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00080000:3.0:1782529260.066939:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529260.070596:0:11551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117244416:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782529260.072285:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529260.072413:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108858496 00000100:00100000:1.0:1782529260.072423:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108858496 00000100:00100000:1.0:1782529260.072484:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:1.0:1782529260.072495:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11497:x1869117108858496:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782529260.072671:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072688:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072700:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072715:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072722:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072729:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072769:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072777:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072783:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529260.072822:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782529260.072827:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529260.072890:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072902:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072914:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072920:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072926:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.072930:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072936:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072947:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:1.0:1782529260.072950:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529260.072955:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072960:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac702 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072971:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072977:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072982:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072986:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.072993:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.072999:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073005:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff99c643b34600) 00010000:00010000:1.0:1782529260.073007:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529260.073010:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073015:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac709 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073028:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073034:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073040:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073044:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.073046:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073051:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073057:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0f300) 00010000:00010000:1.0:1782529260.073059:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529260.073066:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.073072:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac710 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529260.073146:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11497:x1869117108858496:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 652us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529260.073154:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:3.0:1782529260.076967:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529260.077216:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108858752 00000100:00100000:0.0:1782529260.077227:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108858752 00000100:00100000:0.0:1782529260.077434:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:0.0:1782529260.077445:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11497:x1869117108858752:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529260.077467:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529260.077488:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac717 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae04c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077616:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077639:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077650:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529260.077660:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782529260.077754:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077762:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077768:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077774:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529260.077778:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077785:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077796:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0f300) 00010000:00010000:0.0:1782529260.077799:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782529260.077804:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077819:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac71e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077947:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac717 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae04c expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077957:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:0.0:1782529260.077959:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529260.077963:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac717 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae04c expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.077971:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170400, rc 0) 00000100:00100000:0.0:1782529260.078023:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11497:x1869117108858752:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 580us (1065us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1782529260.078029:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:0.0:1782529260.083267:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529260.083413:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108858880 00000100:00100000:1.0:1782529260.083423:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108858880 00000100:00100000:1.0:1782529260.083479:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:1.0:1782529260.083489:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11497:x1869117108858880:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782529260.083524:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782529260.083680:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11497:x1869117108858880:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 191us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529260.083688:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:3.0:1782529260.091824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529260.092013:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108859136 00000100:00100000:1.0:1782529260.092024:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108859136 00000100:00100000:0.0:1782529260.092153:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 175 00000100:00100000:0.0:1782529260.092163:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11497:x1869117108859136:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529260.092183:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529260.092186:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782529260.092210:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac6d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae03e expref: 58 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.092227:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529260.092232:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782529260.092254:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac72c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae053 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782529260.093137:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1782529260.093352:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.093366:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.093375:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.093425:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac72c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae053 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.093439:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae053 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.093447:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529260.093450:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529260.093454:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170a00, rc 0) 00000100:00100000:0.0:1782529260.093577:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11497:x1869117108859136:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1414us (1763us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1782529260.093585:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 175 00000100:00100000:0.0:1782529260.101048:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529260.101224:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108859392 00000100:00100000:1.0:1782529260.101234:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108859392 00000100:00100000:1.0:1782529260.101453:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 176 00000100:00100000:1.0:1782529260.101464:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c642b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11497:x1869117108859392:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782529260.101538:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529260.101566:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae053 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101585:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:1.0:1782529260.101609:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782529260.101642:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101655:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101664:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101678:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101684:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101689:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101767:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101775:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101782:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101787:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.101791:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101798:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101813:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:1.0:1782529260.101815:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529260.101819:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.101825:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac741 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.102052:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.102059:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.102065:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.102071:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.102073:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.102079:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.102088:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe45f5c9 (ffff99c643b34600) 00010000:00010000:1.0:1782529260.102090:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529260.102093:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.102099:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac748 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe45f5c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529260.102430:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c642b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11497:x1869117108859392:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 965us (1389us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782529260.102438:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 176 00000100:00100000:3.0:1782529260.111794:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.111925:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108859520 00000100:00100000:3.0:1782529260.111933:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108859520 00000100:00100000:3.0:1782529260.111988:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 177 00000100:00100000:3.0:1782529260.111999:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11497:x1869117108859520:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529260.112018:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529260.112042:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac74f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae05a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.112076:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.112102:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.112114:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.123939:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eac74f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.123967:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.123977:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:3.0:1782529260.123979:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782529260.123983:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:3.0:1782529260.124067:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11497:x1869117108859520:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 12068us (12301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.124077:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 177 00000100:00100000:3.0:1782529260.142013:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.142051:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108859776 00000100:00100000:3.0:1782529260.142061:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108859776 00000100:00100000:3.0:1782529260.142115:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 178 00000100:00100000:3.0:1782529260.142125:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11497:x1869117108859776:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782529260.142212:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.142231:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.142267:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782529260.148239:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1782529260.148255:0:6616:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322060421067ns, next at 323060417623ns, rc = 0 00000004:00010000:3.0:1782529260.150994:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e1c62b35 reply state 00000000ef42bb5c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529260.151012:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782529260.151157:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11497:x1869117108859776:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 9029us (9150us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1782529260.151166:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 178 00000100:00100000:0.0:1782529260.171975:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529260.172014:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108859904 00000100:00100000:0.0:1782529260.172025:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108859904 00000100:00100000:0.0:1782529260.172076:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 179 00000100:00100000:0.0:1782529260.172086:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11497:x1869117108859904:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529260.172125:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529260.172145:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae061 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.172202:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.172217:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.172237:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:0.0:1782529260.172240:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529260.172243:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170400, rc 0) 00000100:00100000:0.0:1782529260.172600:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11497:x1869117108859904:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 514us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529260.172608:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 179 00010000:00010000:3.0:1782529260.173333:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.173347:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.173355:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.173362:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529260.173367:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.173376:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.173407:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:3.0:1782529260.173410:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782529260.173444:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.173450:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac75d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529260.184193:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.184226:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108860032 00000100:00100000:3.0:1782529260.184234:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108860032 00000100:00100000:3.0:1782529260.184301:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:3.0:1782529260.184310:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108860032:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1782529260.184620:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108860032:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 308us (430us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782529260.184638:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00080000:3.0:1782529260.184663:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529260.198747:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.198786:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108860288 00000100:00100000:3.0:1782529260.198796:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108860288 00000100:00100000:3.0:1782529260.199418:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1782529260.199431:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11497:x1869117108860288:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782529260.199684:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11497:x1869117108860288:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 256us (948us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1782529260.199693:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1782529260.206432:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.206467:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108860544 00000100:00100000:3.0:1782529260.206476:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108860544 00000100:00100000:3.0:1782529260.206527:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 180 00000100:00100000:3.0:1782529260.206536:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11497:x1869117108860544:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782529260.206783:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11497:x1869117108860544:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 247us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.206791:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 180 00000100:00100000:0.0:1782529260.215158:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.215250:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108860672 00000100:00100000:3.0:1782529260.215260:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108860672 00000100:00100000:3.0:1782529260.215322:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 181 00000100:00100000:3.0:1782529260.215332:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11497:x1869117108860672:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529260.215354:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529260.215375:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac76b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae068 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.215450:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.215465:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.215477:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529260.215518:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782529260.215537:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.215576:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac76b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae068 expref: 64 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.215594:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae068 expref: 63 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.215612:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:3.0:1782529260.215616:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782529260.215619:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045000, rc 0) 00000100:00100000:3.0:1782529260.215684:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+63:11497:x1869117108860672:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 354us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.215691:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 181 00000100:00100000:3.0:1782529260.223803:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.223857:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108860800 00000100:00100000:3.0:1782529260.223867:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108860800 00000100:00100000:3.0:1782529260.223926:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1782529260.223937:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108860800:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529260.223958:0:8328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529260.223982:0:8328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae06f expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782529260.224012:0:8328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3f3cec, blocks: 0x1 00010000:00010000:3.0:1782529260.224032:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1782529260.224037:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529260.224048:0:8328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 8 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.224074:0:8328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 8 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.224088:0:8328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045600, rc 0) 00000100:00100000:3.0:1782529260.224160:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108860800:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 224us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.224168:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000001:00080000:2.0:1782529260.227176:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1782529260.227193:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1782529260.228364:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1782529260.228395:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1782529260.228417:0:5816:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99c67f875300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1782529260.228422:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6502b5900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99c67f875b40 00000020:00080000:2.0:1782529260.228425:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6502b5c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99c6805f5800 00000004:00080000:2.0:1782529260.228506:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1782529260.228643:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.228675:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108861056 00000100:00100000:3.0:1782529260.228682:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108861056 00000100:00100000:3.0:1782529260.228733:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 182 00000100:00100000:3.0:1782529260.228743:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11497:x1869117108861056:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000020:00080000:2.0:1782529260.228802:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1782529260.228865:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11497:x1869117108861056:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 123us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.228873:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 182 00000020:00080000:2.0:1782529260.228984:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1782529260.228999:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117244544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782529260.229040:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529260.229101:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117244544 00000100:00100000:2.0:1782529260.229105:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117244544 00000100:00100000:2.0:1782529260.229136:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782529260.229143:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117244544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782529260.229159:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1782529260.229192:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3f3ce9, atime: 0x6a3f3ce9, ctime: 0x6a3f3ce9, blocks: 0xb 00010000:00010000:2.0:1782529260.229201:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.229217:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1782529260.229222:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529260.229227:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.229250:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.229260:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.229268:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.229283:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782529260.232021:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1869117117244544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2872us (2973us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782529260.232035:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1782529260.232110:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529260.232118:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.232131:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529260.232137:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.232148:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.232169:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.232183:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe2b14a8/0x72bfdc08f7eac780 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.232202:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529260.232203:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529260.232205:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529260.232682:0:3296:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1782529260.232690:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1782529260.232715:0:3296:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff99c680cddf80 x1869117117244544/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782529276 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1782529260.232726:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c680cddf80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1782529260.232731:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117244544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782529260.245806:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.245911:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108861184 00000100:00100000:3.0:1782529260.245921:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108861184 00000100:00100000:3.0:1782529260.245982:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1782529260.245992:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:11497:x1869117108861184:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529260.246009:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529260.246028:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae076 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.246057:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 9 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.246079:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529260.246083:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529260.246089:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.246122:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 9 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.246135:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 9 pid: 8328 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529260.246150:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6591:1869117117244672:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529260.246247:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646066cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529260.249543:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6591:1869117117244672:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529260.249577:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.249597:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044600, rc 0) 00000100:00100000:0.0:1782529260.249661:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:11497:x1869117108861184:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 3670us (3865us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529260.249669:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:2.0:1782529260.252445:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529260.252526:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108861312 00000100:00100000:0.0:1782529260.252535:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108861312 00010000:00010000:0.0:1782529260.252569:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 9 pid: 8328 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529260.252648:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:0.0:1782529260.252658:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108861312:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529260.252673:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529260.252695:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 9 pid: 8328 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.252710:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 9 pid: 8328 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.252732:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eac779 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae06f expref: 9 pid: 8328 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.252746:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529260.252750:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529260.252759:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.252769:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.252807:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529260.252829:0:5778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5778:1869117117244800:192.168.202.50@tcp:105: 00000100:00100000:0.0:1782529260.253053:0:5778:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c644f5e240 going to sleep for 11 seconds 00000100:00100000:0.0:1782529260.260516:0:5778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5778:1869117117244800:192.168.202.50@tcp:105: 00010000:00010000:0.0:1782529260.260544:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529260.260602:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108861312:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 7945us (8161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529260.260615:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:0.0:1782529260.270561:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.270792:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108861440 00000100:00100000:3.0:1782529260.270802:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108861440 00002000:00100000:3.0:1782529260.271121:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99c67fae7800 x1869117108861440/t0(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:696/0 lens 504/0 e 0 to 0 dl 1782529271 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529260.271133:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fae7800 with x1869117108861440 ext(0->8) 00002000:00010000:3.0:1782529260.271140:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67fae7800 00000100:00100000:3.0:1782529260.271178:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1782529260.271189:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2342:x1869117108861440:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782529260.272159:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2342:x1869117108861440:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 Request processed in 967us (1600us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1782529260.272311:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00002000:00100000:3.0:1782529260.272320:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99c67fae7800 x1869117108861440/t4294967314(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:696/0 lens 504/448 e 0 to 0 dl 1782529271 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529260.272329:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fae7800 with x1869117108861440 ext(0->8) 00002000:00010000:3.0:1782529260.272334:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67fae7800 00000100:00100000:2.0:1782529260.277028:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.277101:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108861568 00000100:00100000:3.0:1782529260.277111:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108861568 00000100:00100000:3.0:1782529260.277180:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 183 00000100:00100000:3.0:1782529260.277191:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11497:x1869117108861568:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000020:00080000:2.0:1782529260.314265:0:5816:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1782529260.314290:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1782529260.314310:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1782529260.314329:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1782529260.314337:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1782529260.314448:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117244928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782529260.314518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529260.314568:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117244928 00000100:00100000:2.0:1782529260.314575:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117244928 00000100:00100000:2.0:1782529260.314638:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782529260.314647:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117244928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782529260.314793:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782529260.314797:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782529260 00002000:00010000:2.0:1782529260.314799:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782529260.314801:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782529260 -> 1782529260 00002000:00010000:2.0:1782529260.314803:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782529260.314875:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1869117117244928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (357us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1782529260.314898:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1782529260.314918:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1782529260.314949:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c680009c00/2, rc 0, transno 4294967315 00000100:00100000:2.0:1782529260.314954:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117244928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782529260.315608:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11497:x1869117108861568:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 38416us (38587us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.315618:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 183 00000100:00100000:2.0:1782529260.318677:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.318754:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108861696 00000100:00100000:3.0:1782529260.318763:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108861696 00000100:00100000:3.0:1782529260.318821:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:3.0:1782529260.318854:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2343:x1869117108861696:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000040:00080000:3.0:1782529260.376082:0:12324:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529260.376093:0:12324:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529260.376135:0:12324:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1782529260.376151:0:12324:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782529260.399124:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2343:x1869117108861696:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 80284us (80446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.399138:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000001:00080000:0.0:1782529260.399407:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1782529260.399420:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1782529260.404907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529260.405159:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108861952 00000100:00100000:2.0:1782529260.405175:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108861952 00000100:00100000:2.0:1782529260.405240:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 184 00000100:00100000:2.0:1782529260.405251:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11497:x1869117108861952:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782529260.405305:0:6616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529260.405333:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eac772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae068 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.405350:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:2.0:1782529260.405355:0:6616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529260.405386:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.405399:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.405408:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529260.405694:0:6616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096738964 reply state 00000000d24390b6 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529260.405705:0:6616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529260.405805:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:11497:x1869117108861952:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 555us (907us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1782529260.405813:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 184 00010000:00010000:2.0:1782529260.408336:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.408353:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.408360:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.408366:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529260.408372:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.408380:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.408395:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:2.0:1782529260.408398:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529260.408403:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.408408:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac78e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529260.412454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529260.412781:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108862080 00000100:00100000:2.0:1782529260.412790:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108862080 00000100:00100000:2.0:1782529260.412985:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:2.0:1782529260.412996:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2342:x1869117108862080:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782529260.413284:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1782529260.413288:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782529260 -> 1782529259 00002000:00010000:2.0:1782529260.413290:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782529257 00002000:00010000:2.0:1782529260.413292:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782529260 -> 1782529259 00002000:00010000:2.0:1782529260.413294:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1782529260.413354:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2342:x1869117108862080:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 359us (908us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1782529260.413361:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:1.0:1782529260.424197:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529260.424256:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108862336 00000100:00100000:0.0:1782529260.424266:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108862336 00000100:00100000:0.0:1782529260.424319:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 185 00000100:00100000:0.0:1782529260.424329:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11497:x1869117108862336:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782529260.424397:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.424415:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.424424:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.424456:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.424483:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 18 pid: 5795 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529260.424498:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117245056:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529260.430204:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6516fa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529260.451906:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117245056:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529260.451935:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529260.452041:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529260.452098:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108862464 00000100:00100000:2.0:1782529260.452105:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108862464 00010000:00010000:2.0:1782529260.452144:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 19 pid: 5795 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529260.452180:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:2.0:1782529260.452189:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:2343:x1869117108862464:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529260.452205:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529260.452213:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 19 pid: 5795 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.452224:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 19 pid: 5795 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.452271:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae05a expref: 19 pid: 5795 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.452286:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:2.0:1782529260.452290:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.452299:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.452306:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.452324:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529260.452368:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:2343:x1869117108862464:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 180us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529260.452375:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00010000:00010000:2.0:1782529260.458202:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.458223:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.458265:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.458274:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.458281:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.458294:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529260.458298:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.458306:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.458324:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:2.0:1782529260.458328:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1782529260.458334:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.458340:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac795 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529260.458437:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:11497:x1869117108862336:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 Request processed in 34103us (34244us total) trans 0 rc -22/-22 00000100:00100000:2.0:1782529260.458448:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 185 00000100:00100000:3.0:1782529260.463611:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.463797:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108862592 00000100:00100000:3.0:1782529260.463807:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108862592 00000100:00100000:3.0:1782529260.463880:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1782529260.463890:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108862592:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782529260.463930:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.463950:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.463958:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529260.463962:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529260.463967:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.464001:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.464016:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 8 pid: 6591 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529260.464031:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6591:1869117117245184:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529260.464102:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646066c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529260.469016:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529260.469122:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108862720 00000100:00100000:2.0:1782529260.469132:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108862720 00010000:00010000:2.0:1782529260.469182:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 9 pid: 6591 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529260.469216:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:2.0:1782529260.469226:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108862720:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529260.469254:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529260.469278:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 9 pid: 6591 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.469309:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 9 pid: 6591 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.469333:0:8316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529260.469338:0:8316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529260.469344:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.469353:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.469373:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529260.469417:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108862720:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 191us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529260.469424:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00010000:00010000:0.0:1782529260.469664:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009985effd/0x72bfdc08f7eac787 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae076 expref: 8 pid: 6591 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529260.469680:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6591:1869117117245184:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529260.469699:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469708:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469715:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469737:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469745:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469763:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469769:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972bc00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529260.469773:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469781:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469792:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529260.469799:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081070c95/0x72bfdc08f7eac79c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529260.469872:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108862592:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 5984us (6271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529260.469880:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:2.0:1782529260.482492:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.482572:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108862976 00000100:00100000:3.0:1782529260.482582:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108862976 00000100:00100000:3.0:1782529260.482650:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 186 00000100:00100000:3.0:1782529260.482671:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+17:11497:x1869117108862976:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782529260.482748:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.482765:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.482776:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.483009:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.483021:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.483029:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.483061:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.483074:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 18 pid: 5794 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529260.483089:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117245312:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529260.483162:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646066c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782529260.486026:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117245312:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529260.486055:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529260.487334:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.487545:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108863104 00000100:00100000:3.0:1782529260.487555:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108863104 00010000:00010000:3.0:1782529260.487592:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 19 pid: 5794 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529260.487654:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:3.0:1782529260.487663:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:2343:x1869117108863104:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529260.487681:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529260.487688:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 19 pid: 5794 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.487701:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 19 pid: 5794 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.487722:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae061 expref: 19 pid: 5794 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.487740:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:3.0:1782529260.487745:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.487754:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.487762:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.487790:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529260.487865:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:2343:x1869117108863104:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 202us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.487873:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00010000:00010000:2.0:1782529260.488098:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529260.488107:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529260.488299:0:6616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1782529260.488460:0:6616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1782529260.488505:0:6616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1782529260.488602:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6616:1869117117245440:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782529260.488661:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529260.488690:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6456a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782529260.488927:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117245440 00000100:00100000:3.0:1782529260.488940:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117245440 00000100:00100000:3.0:1782529260.488990:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782529260.488998:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6616:x1869117117245440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782529260.489077:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6616:x1869117117245440:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.489084:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782529260.489344:0:6616:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1782529260.489351:0:6616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c680009c00, transno 4294967315 00000100:00100000:1.0:1782529260.489371:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6616:1869117117245440:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1782529260.489888:0:6616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1782529260.489945:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6773b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6616:1869117117245568:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782529260.490650:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529260.490682:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6461b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1782529260.490695:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117245568 00000100:00100000:3.0:1782529260.490701:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117245568 00000100:00100000:3.0:1782529260.490754:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782529260.490763:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6616:x1869117117245568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782529260.490981:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6616:x1869117117245568:12345-0@lo:1000:mdt00_003.0 Request processed in 219us (339us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1782529260.490989:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782529260.491036:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6773b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6616:1869117117245568:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1782529260.491075:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491085:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491092:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491099:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ac00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.491103:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491110:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491136:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9200) 00010000:00010000:1.0:1782529260.491139:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782529260.491143:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491149:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491177:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491183:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491188:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491194:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.491196:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491202:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491209:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0f300) 00010000:00010000:1.0:1782529260.491212:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782529260.491215:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491220:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac6df lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491253:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491266:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 21 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491275:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491304:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 21 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.491317:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 21 pid: 6616 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529260.491329:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c660029f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117245696:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529260.491406:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6461b0240 going to sleep for 11 seconds 00000100:00100000:1.0:1782529260.495579:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c660029f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117245696:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529260.495611:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529260.505247:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.505385:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108863232 00000100:00100000:3.0:1782529260.505395:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108863232 00010000:00010000:3.0:1782529260.505434:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 22 pid: 6616 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529260.505475:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:3.0:1782529260.505485:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:2343:x1869117108863232:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529260.505499:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529260.505506:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 22 pid: 6616 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.505519:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 22 pid: 6616 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.505558:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac6fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae045 expref: 22 pid: 6616 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.505574:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0f300) 00010000:00010000:3.0:1782529260.505579:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.505589:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.505596:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.505645:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782529260.505685:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505694:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529260.505695:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:2343:x1869117108863232:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 211us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529260.505703:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00010000:00010000:1.0:1782529260.505717:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505724:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505731:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505737:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.505747:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505753:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505762:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0f300) 00010000:00010000:1.0:1782529260.505765:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529260.505769:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505774:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7400/0x72bfdc08f7eac7b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505786:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505791:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505797:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505809:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529260.505812:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505818:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505826:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0f300) 00010000:00010000:1.0:1782529260.505828:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782529260.505853:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.505860:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529260.506064:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11497:x1869117108862976:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 23395us (23578us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1782529260.506073:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 186 00000020:00080000:1.0:1782529260.506078:0:6616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782529260.506266:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529260.506271:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529260.507488:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1782529260.507514:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782529260.518553:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529260.518722:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108863488 00000100:00100000:3.0:1782529260.518732:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108863488 00000100:00100000:3.0:1782529260.518789:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:3.0:1782529260.518799:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c665758050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11497:x1869117108863488:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782529260.519478:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782529260.519579:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1782529260.519656:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.519672:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.519684:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.519692:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.519699:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.519705:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529260.519723:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782529260.519823:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c665758050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:11497:x1869117108863488:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 1024us (1278us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1782529260.519855:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000020:00080000:3.0:1782529260.519862:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782529260.521969:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529260.521982:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.521994:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972bc00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529260.521997:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.522006:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.522033:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99c6601f9400) 00010000:00010000:1.0:1782529260.522036:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782529260.522041:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.522047:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529260.522063:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529260.522065:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529260.522067:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529260.999043:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529261.649750:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117245824:0@lo:400:kworker.0 00000100:00100000:0.0:1782529261.649820:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529261.649882:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117246336:0@lo:400:kworker.0 00000100:00100000:0.0:1782529261.649907:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529261.649932:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782529261.649945:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117245952:0@lo:400:kworker.0 00000100:00100000:0.0:1782529261.649963:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529261.649975:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117246464:0@lo:400:kworker.0 00000100:00100000:0.0:1782529261.649993:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529261.650020:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117246336 00000100:00100000:0.0:1782529261.650027:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117246336 00000100:00100000:0.0:1782529261.650069:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117245952 00000100:00100000:0.0:1782529261.650071:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117245952 00000100:00100000:0.0:1782529261.650087:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782529261.650094:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117246336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529261.650141:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117246336:12345-0@lo:400:kworker.0 Request processed in 46us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529261.650147:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782529261.650164:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782529261.650170:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117245952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529261.650193:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117245952:12345-0@lo:400:kworker.0 Request processed in 24us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529261.650199:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782529261.650297:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117245952:0@lo:400:kworker.0 00000100:00100000:0.0:1782529261.650310:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117246336:0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.650502:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117246080:0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.650538:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529261.650562:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529261.650568:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117246208:0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.650587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529261.650628:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117245824 00000100:00100000:2.0:1782529261.650632:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117245824 00000100:00100000:2.0:1782529261.650658:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1782529261.650664:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117245824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.650697:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117245824:12345-0@lo:400:kworker.0 Request processed in 33us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529261.650703:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1782529261.650728:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117246080 00000100:00100000:2.0:1782529261.650730:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117246080 00000100:00100000:2.0:1782529261.650749:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782529261.650754:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117246080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.650779:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117246080:12345-0@lo:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529261.650785:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782529261.650809:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117246464 00000100:00100000:2.0:1782529261.650812:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117246464 00000100:00100000:2.0:1782529261.650850:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117246208 00000100:00100000:2.0:1782529261.650853:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117246208 00000100:00100000:2.0:1782529261.650870:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782529261.650875:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1869117117246464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.650901:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1869117117246464:12345-0@lo:400:kworker.0 Request processed in 26us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529261.650906:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782529261.650915:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782529261.650920:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1869117117246208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.650939:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1869117117246208:12345-0@lo:400:kworker.0 Request processed in 19us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529261.650945:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1782529261.650956:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782529261.650960:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529261.650981:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117246208:0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.650989:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117246080:0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.651016:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117246464:0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.651023:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117245824:0@lo:400:kworker.0 00000100:00100000:2.0:1782529261.653704:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117246592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529261.653777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529261.653877:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117246592 00000100:00100000:0.0:1782529261.653885:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117246592 00000100:00100000:0.0:1782529261.653935:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782529261.653943:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1869117117246592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782529261.653968:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1782529261.660450:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1869117117246592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6495us (6660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529261.660474:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782529261.661067:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117246592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782529262.025379:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782529262.324487:0:12388:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782529262.324498:0:12388:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529262.324551:0:12388:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782529262.324558:0:12388:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782529262.512058:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529262.512105:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108863744 00000100:00100000:1.0:1782529262.512116:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108863744 00000100:00100000:1.0:1782529262.512183:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 187 00000100:00100000:1.0:1782529262.512194:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66002b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:11529:x1869117108863744:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529262.512228:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529262.512252:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac7bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae07d expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.512515:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac7c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.512530:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac7c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.512542:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac7c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529262.512565:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1782529262.512753:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac7bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae07d expref: 25 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.512771:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac7c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae07d expref: 24 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.512781:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:1.0:1782529262.512784:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782529262.512787:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6800, rc 0) 00000100:00100000:1.0:1782529262.512872:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66002b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:11529:x1869117108863744:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 679us (826us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1782529262.512881:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 187 00000100:00080000:1.0:1782529262.513045:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529262.519966:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529262.520032:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108863872 00000100:00100000:0.0:1782529262.520042:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108863872 00000100:00100000:0.0:1782529262.520100:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 188 00000100:00100000:0.0:1782529262.520109:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:11529:x1869117108863872:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:0.0:1782529262.520178:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520194:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520205:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520269:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520276:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520282:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520547:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520555:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520561:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782529262.520621:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520634:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520640:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520648:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520653:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529262.520657:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520664:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520676:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529262.520679:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529262.520683:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520689:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac7d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520700:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520706:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520716:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520721:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529262.520724:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520729:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520736:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c642b0f300) 00010000:00010000:0.0:1782529262.520738:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529262.520741:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520746:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac7db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520759:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520764:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520770:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520775:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529262.520778:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520790:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520797:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529262.520799:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529262.520802:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.520807:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac7e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529262.520894:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:11529:x1869117108863872:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 785us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529262.520901:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 188 00000100:00100000:3.0:1782529262.581556:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529262.581592:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108864128 00000100:00100000:3.0:1782529262.581601:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108864128 00000100:00100000:3.0:1782529262.581659:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 189 00000100:00100000:3.0:1782529262.581669:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+24:11532:x1869117108864128:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1782529262.581689:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529262.581708:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae084 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.581797:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.581812:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.581823:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.581861:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.581870:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.581878:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.584753:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.584772:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.584783:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529262.584798:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1782529262.591333:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591353:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591362:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591369:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972b200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529262.591374:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591382:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591473:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529262.591485:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529262.591491:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591498:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac7f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591515:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591521:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591528:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591533:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ac00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529262.591536:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591542:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591549:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c6601f9c00) 00010000:00010000:0.0:1782529262.591551:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529262.591554:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591559:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac7f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591623:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac7e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 27 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591649:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 26 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.591656:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:0.0:1782529262.591659:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529262.591661:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044600, rc 0) 00000100:00100000:0.0:1782529262.591731:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:11532:x1869117108864128:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 10062us (10184us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1782529262.591740:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 189 00000100:00100000:1.0:1782529262.597652:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529262.597732:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108864256 00000100:00100000:0.0:1782529262.597742:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108864256 00000100:00100000:0.0:1782529262.597871:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 190 00000100:00100000:0.0:1782529262.597883:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:11532:x1869117108864256:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:0.0:1782529262.598114:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598131:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598143:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598182:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598190:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598215:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598222:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529262.598227:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598234:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598246:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:0.0:1782529262.598250:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529262.598255:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.598262:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac80c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529262.598342:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:11532:x1869117108864256:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 460us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529262.598350:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 190 00000100:00100000:1.0:1782529262.608130:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529262.611110:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108864512 00000100:00100000:3.0:1782529262.611128:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108864512 00000100:00100000:2.0:1782529262.615134:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:2.0:1782529262.615149:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:11532:x1869117108864512:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1782529262.615662:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:11532:x1869117108864512:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 513us (7540us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1782529262.615671:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1782529262.678512:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529262.678668:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108864768 00000100:00100000:2.0:1782529262.678678:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108864768 00000100:00100000:2.0:1782529262.678748:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 191 00000100:00100000:2.0:1782529262.678761:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:11045:x1869117108864768:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529262.678786:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529262.678820:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac813 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae08b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.679305:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.679320:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 28 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.679329:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.679364:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 28 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.679388:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 28 pid: 6616 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529262.679403:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c6457f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117246720:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529262.679509:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646066480 going to sleep for 11 seconds 00000100:00100000:1.0:1782529262.685648:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529262.685776:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c6457f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117246720:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529262.685818:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529262.686102:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108864896 00000100:00100000:2.0:1782529262.686111:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108864896 00010000:00010000:2.0:1782529262.686149:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 29 pid: 6616 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529262.686189:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:2.0:1782529262.686198:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f873b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:2343:x1869117108864896:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529262.686213:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529262.686219:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 29 pid: 6616 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.686238:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 29 pid: 6616 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.686272:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044600/0x72bfdc08f7eac7fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae084 expref: 29 pid: 6616 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.686289:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:2.0:1782529262.686294:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.686303:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.686310:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.686413:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529262.686514:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f873b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:2343:x1869117108864896:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 316us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529262.686522:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 74 00010000:00010000:1.0:1782529262.686581:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.686589:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529262.686619:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782529262.686761:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac813 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 29 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.686789:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.686797:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:1.0:1782529262.686815:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782529262.686818:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:1.0:1782529262.686889:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:11045:x1869117108864768:12345-192.168.202.50@tcp:101:bash.0 Request processed in 8130us (8385us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1782529262.686896:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 191 00000100:00100000:1.0:1782529262.693551:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529262.694497:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108865152 00000100:00100000:0.0:1782529262.694508:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108865152 00000100:00100000:0.0:1782529262.694567:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 192 00000100:00100000:0.0:1782529262.694576:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:11045:x1869117108865152:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:0.0:1782529262.694828:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.694883:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.694914:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782529262.699200:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1782529262.699254:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce4ff04f reply state 000000002cd1d0d0 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529262.699265:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782529262.699360:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1782529262.699485:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:11045:x1869117108865152:12345-192.168.202.50@tcp:36:bash.0 Request processed in 4905us (5938us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1782529262.699495:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 192 00000020:00080000:0.0:1782529262.699500:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1782529262.704218:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.704238:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.704245:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.704270:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529262.704275:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.704283:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.704300:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:3.0:1782529262.704303:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529262.704307:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.704325:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac828 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529262.705521:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529262.707247:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108865280 00000100:00100000:0.0:1782529262.707257:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108865280 00000100:00100000:0.0:1782529262.707311:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 193 00000100:00100000:0.0:1782529262.707318:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:11045:x1869117108865280:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1782529262.707338:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529262.707355:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac82f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae092 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.707412:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac82f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae092 expref: 32 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.707424:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac82f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae092 expref: 32 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.707439:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:0.0:1782529262.707453:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529262.707456:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170000, rc 0) 00000100:00100000:0.0:1782529262.707515:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:11045:x1869117108865280:12345-192.168.202.50@tcp:101:bash.0 Request processed in 197us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529262.707520:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 193 00000100:00100000:0.0:1782529262.712758:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529262.712906:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108865408 00000100:00100000:2.0:1782529262.712924:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108865408 00000100:00080000:1.0:1782529262.712988:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529262.712998:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:2.0:1782529262.713010:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:11045:x1869117108865408:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529262.713029:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529262.713052:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae099 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529262.713080:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3f3ceb, atime: 0x6a3f3ce9, ctime: 0x6a3f3ceb, blocks: 0xb 00010000:00010000:2.0:1782529262.713117:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1782529262.713135:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529262.713144:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.713163:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.713176:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00400, rc 0) 00000100:00100000:2.0:1782529262.713234:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:11045:x1869117108865408:12345-192.168.202.50@tcp:101:bash.0 Request processed in 226us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529262.713242:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:3.0:1782529262.715161:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529262.716022:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108865536 00000100:00100000:2.0:1782529262.716035:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108865536 00002000:00010000:2.0:1782529262.716082:0:6597:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1782529262.716098:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c6457f7b80 with x1869117108865536 ext(0->18446744073709551615) 00002000:00010000:2.0:1782529262.716113:0:6597:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c6457f7b80. 00000100:00100000:2.0:1782529262.716155:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:2.0:1782529262.716165:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108865536:12345-192.168.202.50@tcp:10:bash.0 00002000:00010000:2.0:1782529262.716614:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1782529262.716619:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782529259 -> 1782529263 00002000:00010000:2.0:1782529262.716621:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1782529257 -> 1782529257 00002000:00010000:2.0:1782529262.716624:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782529259 -> 1782529263 00002000:00010000:2.0:1782529262.716626:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1782529262.716711:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108865536:12345-192.168.202.50@tcp:10:bash.0 Request processed in 546us (1556us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1782529262.716723:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00002000:00010000:2.0:1782529262.716744:0:6597:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1782529262.716747:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c6457f7b80 with x1869117108865536 ext(0->18446744073709551615) 00002000:00010000:2.0:1782529262.716755:0:6597:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c6457f7b80. 00000100:00100000:1.0:1782529262.787181:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529262.787497:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108865664 00000100:00100000:2.0:1782529262.787508:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108865664 00000100:00100000:2.0:1782529262.787584:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 194 00000100:00100000:2.0:1782529262.787596:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:11546:x1869117108865664:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1782529262.787722:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.787740:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.787753:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.787769:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.787777:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.787784:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788125:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788135:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788141:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529262.788190:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788202:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788208:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788215:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788221:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529262.788225:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788233:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788247:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:2.0:1782529262.788249:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529262.788253:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788259:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac83d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788270:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788275:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788287:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788292:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529262.788295:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788300:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788310:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c669568f00) 00010000:00010000:2.0:1782529262.788312:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529262.788315:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788320:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788334:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788341:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788345:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788350:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529262.788352:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788368:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788377:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:2.0:1782529262.788379:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529262.788382:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.788387:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac84b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529262.788453:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:11546:x1869117108865664:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 858us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529262.788461:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 194 00000100:00100000:3.0:1782529262.829549:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529262.829870:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108865920 00000100:00100000:0.0:1782529262.829880:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108865920 00000100:00100000:0.0:1782529262.829931:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 195 00000100:00100000:0.0:1782529262.829940:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+32:11549:x1869117108865920:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529262.829958:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529262.829977:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac852 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0a0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830047:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830061:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830072:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830086:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830093:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830100:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830720:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830731:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830738:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529262.830746:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782529262.830936:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830945:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830952:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830958:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529262.830962:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830970:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.830982:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529262.830985:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529262.830990:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831007:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac859 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831021:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831027:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831033:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831037:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529262.831040:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831045:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831053:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529262.831056:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529262.831059:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831064:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831110:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac852 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0a0 expref: 35 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831125:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0a0 expref: 34 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.831139:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:0.0:1782529262.832106:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782529262.832114:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972bc00, rc 0) 00000100:00100000:0.0:1782529262.832205:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:11549:x1869117108865920:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 2264us (2665us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1782529262.832338:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 195 00000100:00100000:3.0:1782529262.835663:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529262.835788:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108866048 00000100:00100000:0.0:1782529262.835799:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108866048 00000100:00100000:0.0:1782529262.835880:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 196 00000100:00100000:0.0:1782529262.835891:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:11549:x1869117108866048:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:0.0:1782529262.835958:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.835974:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.835982:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.836017:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529262.836031:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 34 pid: 5795 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529262.836045:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117246848:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529262.836144:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6806cecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529262.839182:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c680a41180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117246848:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529262.839214:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529262.840513:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529262.842957:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108866304 00000100:00100000:0.0:1782529262.842969:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108866304 00000100:00100000:0.0:1782529262.843028:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:0.0:1782529262.843037:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:5559:x1869117108866304:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782529262.843353:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:5559:x1869117108866304:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 316us (2845us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1782529262.843362:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:2.0:1782529262.846493:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529262.846578:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108866432 00000100:00100000:3.0:1782529262.846589:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108866432 00010000:00010000:3.0:1782529262.846644:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 36 pid: 5795 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529262.846685:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:3.0:1782529262.846695:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650284c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:2344:x1869117108866432:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529262.846709:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529262.846715:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 36 pid: 5795 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.846742:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 36 pid: 5795 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.846765:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eac81a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae08b expref: 36 pid: 5795 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.846782:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:3.0:1782529262.846787:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.846797:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.846806:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529262.846917:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529262.846967:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650284c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:2344:x1869117108866432:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 274us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529262.846975:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 75 00010000:00010000:2.0:1782529262.849271:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.849288:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.849329:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.849336:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.849342:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.849348:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ac00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529262.849371:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.849379:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.849396:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:2.0:1782529262.849399:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782529262.849403:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529262.849410:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529262.849957:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:11549:x1869117108866048:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 14061us (14295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529262.849967:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 196 00000100:00100000:2.0:1782529262.855110:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529262.855333:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108866688 00000100:00100000:1.0:1782529262.855344:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108866688 00000100:00100000:1.0:1782529262.855405:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:1.0:1782529262.855415:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+34:11549:x1869117108866688:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1782529262.855642:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:11549:x1869117108866688:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 227us (541us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1782529262.855649:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1782529262.972281:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529262.972391:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108866944 00000100:00100000:1.0:1782529262.972401:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108866944 00000100:00100000:1.0:1782529262.972464:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 197 00000100:00100000:1.0:1782529262.972475:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+35:11560:x1869117108866944:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:1.0:1782529262.972502:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529262.972535:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac87c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0a7 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.972662:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.972678:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.972689:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.972705:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.972712:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.972719:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973058:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973068:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973075:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529262.973085:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1782529262.973168:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973186:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973192:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973198:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529262.973203:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973209:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973220:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:1.0:1782529262.973223:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529262.973227:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973233:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac883 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973246:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973251:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973258:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973263:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529262.973271:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973277:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973284:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c643b34600) 00010000:00010000:1.0:1782529262.973287:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529262.973289:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973295:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac88a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973337:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac87c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0a7 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973350:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0a7 expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529262.973357:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:1.0:1782529262.973359:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782529262.973362:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7a00, rc 0) 00000100:00100000:1.0:1782529262.973417:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:11560:x1869117108866944:12345-192.168.202.50@tcp:101:cat.0 Request processed in 943us (1155us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1782529262.973425:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 197 00000100:00100000:1.0:1782529262.982619:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529262.982758:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108867200 00000100:00100000:2.0:1782529262.982768:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108867200 00000100:00100000:2.0:1782529262.982829:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:2.0:1782529262.982870:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:11560:x1869117108867200:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:2.0:1782529262.983095:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+38:11560:x1869117108867200:12345-192.168.202.50@tcp:35:cat.0 Request processed in 227us (499us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1782529262.983104:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:2.0:1782529263.012946:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529263.013090:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108867456 00000100:00100000:1.0:1782529263.013101:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108867456 00000100:00100000:1.0:1782529263.013162:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 198 00000100:00100000:1.0:1782529263.013183:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+38:11561:x1869117108867456:12345-192.168.202.50@tcp:36:rm.0 00010000:00010000:1.0:1782529263.013251:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782529263.013276:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0a7 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013299:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0a0 expref: 37 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013312:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac82f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae092 expref: 36 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013322:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c6601f9500) 00010000:00010000:1.0:1782529263.013332:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782529263.013352:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013365:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013374:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013388:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013395:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013401:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013728:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013736:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.013743:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782529263.014400:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1782529263.014411:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324926576985ns, next at 325926574560ns, rc = 0 00010000:00010000:1.0:1782529263.014471:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014482:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014491:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014498:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014504:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014511:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014542:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529263.014563:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014577:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014582:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014589:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529263.014594:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014601:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014622:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c643b34e00) 00010000:00010000:1.0:1782529263.014625:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782529263.014630:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014636:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014655:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014660:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014665:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014670:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529263.014678:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014684:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014692:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:1.0:1782529263.014694:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529263.014697:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.014703:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac89f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782529263.014713:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d51b03d9 reply state 0000000014f89048 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529263.014721:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782529263.014801:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+37:11561:x1869117108867456:12345-192.168.202.50@tcp:36:rm.0 Request processed in 1618us (1863us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1782529263.014810:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 198 00010000:00010000:0.0:1782529263.015242:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529263.015248:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.015255:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7800 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529263.015259:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.015267:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.015277:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99c643b34e00) 00010000:00010000:0.0:1782529263.015280:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782529263.015283:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.015290:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7800/0x72bfdc08f7eac8b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.015313:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529263.015315:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529263.015317:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529263.018016:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.018035:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.018056:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.018062:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529263.018066:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.018074:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.018090:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c643b34600) 00010000:00010000:2.0:1782529263.018092:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529263.018096:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.018102:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eac8a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.047071:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529263.075814:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529263.075974:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108867712 00000100:00100000:1.0:1782529263.075983:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108867712 00000100:00100000:1.0:1782529263.076042:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 199 00000100:00100000:1.0:1782529263.076052:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+36:11567:x1869117108867712:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1782529263.076078:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529263.076099:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac8bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0ae expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.076215:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.076255:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.076267:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.076283:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.076291:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.076297:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782529263.076820:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1782529263.077009:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077019:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077027:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077058:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077065:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077072:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077084:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529263.077088:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077095:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077107:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:1.0:1782529263.077110:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529263.077114:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077120:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7c00/0x72bfdc08f7eac8c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782529263.077133:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b2f403c reply state 0000000006b83ceb transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529263.077141:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782529263.077168:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6a00/0x72bfdc08f7eac8bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077180:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.077186:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34400) 00010000:00010000:1.0:1782529263.077188:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782529263.077190:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7600, rc 0) 00000100:00100000:1.0:1782529263.077264:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:11567:x1869117108867712:12345-192.168.202.50@tcp:101:bash.0 Request processed in 1213us (1458us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1782529263.077278:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 199 00010000:00010000:2.0:1782529263.080054:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.080070:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.080078:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.080084:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529263.080089:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.080110:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.080125:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c643b34d00) 00010000:00010000:2.0:1782529263.080128:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529263.080133:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.080139:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eac8c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.085967:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.087292:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108867840 00000100:00100000:0.0:1782529263.087304:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108867840 00000100:00100000:0.0:1782529263.087414:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:0.0:1782529263.087425:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108867840:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1782529263.087443:0:8328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529263.087463:0:8328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0b5 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782529263.087491:0:8328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529263.087510:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1782529263.087514:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529263.087523:0:8328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 6 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.087543:0:8328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 6 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.087557:0:8328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972b200, rc 0) 00000100:00100000:0.0:1782529263.087634:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2343:x1869117108867840:12345-192.168.202.50@tcp:101:bash.0 Request processed in 211us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529263.087642:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00080000:1.0:1782529263.087695:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529263.093239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.093461:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108867968 00000100:00100000:2.0:1782529263.093470:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108867968 00000100:00100000:2.0:1782529263.093517:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:2.0:1782529263.093524:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:11567:x1869117108867968:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529263.093538:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529263.093552:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0bc expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.093577:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 7 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.093584:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782529263.093587:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529263.093590:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.093643:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 7 pid: 8328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.093657:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 7 pid: 8328 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.093670:0:6592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1869117117246976:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529263.093758:0:6592:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6456a7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782529263.095675:0:6592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1869117117246976:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529263.096032:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.096054:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01400, rc 0) 00000100:00100000:2.0:1782529263.096104:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:11567:x1869117108867968:12345-192.168.202.50@tcp:101:bash.0 Request processed in 2580us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529263.096113:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:1.0:1782529263.096548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.096598:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108868096 00000100:00100000:2.0:1782529263.096613:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108868096 00010000:00010000:2.0:1782529263.096647:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 7 pid: 8328 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.096680:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:2.0:1782529263.096690:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108868096:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529263.096719:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529263.096740:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 7 pid: 8328 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.096752:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 7 pid: 8328 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.096775:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eac8de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0b5 expref: 7 pid: 8328 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.096789:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529263.096794:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529263.096802:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 6 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.096813:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 6 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.097047:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 6 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.097062:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c89880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5780:1869117117247104:192.168.202.50@tcp:105: 00000100:00100000:2.0:1782529263.097124:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6456a7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782529263.100524:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c89880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5780:1869117117247104:192.168.202.50@tcp:105: 00010000:00010000:2.0:1782529263.100550:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529263.100630:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2344:x1869117108868096:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 3941us (4081us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529263.100640:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:3.0:1782529263.103751:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.103877:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108868352 00000100:00100000:2.0:1782529263.103888:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108868352 00000100:00100000:2.0:1782529263.103937:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:2.0:1782529263.103945:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+38:11567:x1869117108868352:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:2.0:1782529263.104309:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:11567:x1869117108868352:12345-192.168.202.50@tcp:35:bash.0 Request processed in 364us (566us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1782529263.104318:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:1.0:1782529263.270893:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.271434:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108868480 00000100:00100000:0.0:1782529263.271460:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108868480 00000100:00100000:0.0:1782529263.271526:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 200 00000100:00100000:0.0:1782529263.271536:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+39:11583:x1869117108868480:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529263.271559:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529263.271579:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac8ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0c3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.271666:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac8f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.271681:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.271694:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529263.271757:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1782529263.271762:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529263.271788:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.271814:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac8ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0c3 expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.271884:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0c3 expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.271895:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529263.271898:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782529263.271901:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972b200, rc 0) 00000100:00100000:0.0:1782529263.271979:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:11583:x1869117108868480:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 444us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529263.271987:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 200 00000100:00100000:3.0:1782529263.278140:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529263.278505:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108868736 00000100:00100000:1.0:1782529263.278518:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108868736 00000100:00100000:1.0:1782529263.278591:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 201 00000100:00100000:1.0:1782529263.278608:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6773b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+40:11583:x1869117108868736:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529263.278628:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529263.278650:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac8fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0ca expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.278748:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.278772:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.278783:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529263.278794:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782529263.278942:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6c00/0x72bfdc08f7eac8fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ca expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.278971:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ca expref: 42 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.278999:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34400) 00010000:00010000:1.0:1782529263.279002:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782529263.279005:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6e00, rc 0) 00000100:00100000:1.0:1782529263.279056:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6773b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+42:11583:x1869117108868736:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 457us (925us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1782529263.279062:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 201 00000100:00100000:1.0:1782529263.289687:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.289789:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108868992 00000100:00100000:0.0:1782529263.289798:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108868992 00000100:00100000:0.0:1782529263.289891:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 202 00000100:00100000:0.0:1782529263.289902:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+42:11583:x1869117108868992:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529263.289936:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529263.289954:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac90f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0d1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.290057:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac916 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.290071:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac916 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.290081:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac916 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529263.290093:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782529263.290224:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac90f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0d1 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.290828:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac916 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0d1 expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.290891:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34400) 00010000:00010000:0.0:1782529263.290894:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782529263.290917:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972bc00, rc 0) 00000100:00100000:0.0:1782529263.295189:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+44:11583:x1869117108868992:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 5274us (5498us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1782529263.295203:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 202 00000100:00100000:1.0:1782529263.297960:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529263.298247:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108869120 00000100:00100000:3.0:1782529263.298258:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108869120 00000100:00100000:3.0:1782529263.298319:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1782529263.298329:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+44:2344:x1869117108869120:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529263.298361:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529263.298384:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6e00/0x72bfdc08f7eac901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ca expref: 44 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.298403:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34400) 00010000:00010000:3.0:1782529263.298408:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529263.298463:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:2344:x1869117108869120:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 135us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529263.298471:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1782529263.309594:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.315187:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108869248 00000100:00100000:0.0:1782529263.315201:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108869248 00000100:00100000:0.0:1782529263.315282:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:0.0:1782529263.315292:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6457f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+6:2341:x1869117108869248:12345-192.168.202.50@tcp:1:lfs.0 00010000:00010000:0.0:1782529263.315341:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.315361:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 6 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.315369:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529263.315372:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782529263.315376:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.315412:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 6 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.315424:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 6 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529263.315441:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6591:1869117117247232:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529263.315527:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6806cecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529263.320097:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.320281:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108869376 00000100:00100000:2.0:1782529263.320290:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108869376 00002000:00100000:2.0:1782529263.320339:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99c677a9c700 x1869117108869376/t0(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:699/0 lens 504/0 e 0 to 0 dl 1782529274 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782529263.320350:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c677a9c700 with x1869117108869376 ext(0->8) 00010000:00010000:2.0:1782529263.320360:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 7 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.320378:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 7 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529263.320387:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99c677a9c700 00000100:00100000:2.0:1782529263.320421:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:2.0:1782529263.320432:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108869376:12345-192.168.202.50@tcp:4:lfs.0 00000100:00100000:2.0:1782529263.320983:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108869376:12345-192.168.202.50@tcp:4:lfs.0 Request processed in 551us (895us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782529263.321001:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00002000:00100000:2.0:1782529263.321009:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99c677a9c700 x1869117108869376/t4294967308(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:699/0 lens 504/448 e 0 to 0 dl 1782529274 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782529263.321017:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c677a9c700 with x1869117108869376 ext(0->8) 00010000:00010000:2.0:1782529263.321024:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 9 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.321037:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 9 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529263.321043:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99c677a9c700 00000100:00100000:0.0:1782529263.322433:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6591:1869117117247232:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529263.322462:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529263.324914:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529263.325369:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108869504 00000100:00100000:3.0:1782529263.325380:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108869504 00010000:00010000:3.0:1782529263.325420:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 9 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529263.325464:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:3.0:1782529263.325474:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108869504:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529263.325489:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782529263.325507:0:5779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782529263.325510:0:5779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782529263 00002000:00010000:3.0:1782529263.325513:0:5779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782529263 00002000:00010000:3.0:1782529263.325515:0:5779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782529263 00010000:00010000:3.0:1782529263.325521:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 9 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.325553:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 9 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.325576:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9c29c14/0x72bfdc08f7eac8e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0bc expref: 9 pid: 6592 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.325593:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529263.325597:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529263.326629:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.326642:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.326678:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529263.326743:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108869504:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 1267us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529263.326762:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 77 00010000:00010000:0.0:1782529263.327132:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.327156:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.327189:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.327198:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.327204:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.327221:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ac00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529263.327225:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.327234:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.327274:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.327281:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e283b52/0x72bfdc08f7eac924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529263.327334:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6457f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2341:x1869117108869248:12345-192.168.202.50@tcp:1:lfs.0 Request processed in 12044us (17750us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529263.327342:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:1.0:1782529263.330985:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.331406:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108869760 00000100:00100000:2.0:1782529263.331417:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108869760 00000100:00100000:2.0:1782529263.331476:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:2.0:1782529263.331486:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c66575a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+43:11583:x1869117108869760:12345-192.168.202.50@tcp:35:lfs.0 00000004:00010000:2.0:1782529263.331548:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac916 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0d1 expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529263.331818:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1782529263.331913:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1782529263.332619:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1782529263.332679:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.332697:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.332728:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.332770:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.332786:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 47 pid: 5795 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.332802:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1869117117247360:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529263.335222:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6456a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529263.353721:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529263.354194:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108869888 00000100:00100000:3.0:1782529263.354205:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108869888 00010000:00010000:3.0:1782529263.354262:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 48 pid: 5795 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529263.354306:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:3.0:1782529263.354316:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+48:2344:x1869117108869888:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529263.354347:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529263.354355:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 48 pid: 5795 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.354368:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 48 pid: 5795 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.354390:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34400) 00010000:00010000:3.0:1782529263.354395:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.354406:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.354414:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.354432:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529263.354492:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+48:2344:x1869117108869888:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 178us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529263.354499:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 78 00010000:00010000:2.0:1782529263.355675:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eac8d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ae expref: 47 pid: 5795 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.355698:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1869117117247360:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529263.355720:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.355729:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.355734:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529263.355911:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1782529263.356519:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1782529263.356647:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c650c89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117247488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782529263.356722:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529263.357397:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6456a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529263.357466:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117247488 00000100:00100000:1.0:1782529263.357474:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117247488 00000100:00100000:1.0:1782529263.357543:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782529263.357552:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1869117117247488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782529263.357654:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1869117117247488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529263.357662:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782529263.357749:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c650c89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117247488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782529263.358516:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1782529263.358590:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117247616:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1782529263.359109:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529263.359201:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529263.359422:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6806ce600 going to sleep for 11 seconds 00000100:00100000:1.0:1782529263.359489:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117247616 00000100:00100000:1.0:1782529263.359495:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117247616 00000100:00100000:1.0:1782529263.359583:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782529263.359592:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1869117117247616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782529263.359829:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5798:x1869117117247616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 237us (628us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782529263.359865:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782529263.359961:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869117117247616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782529263.360033:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1782529263.360076:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.360087:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.360095:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.360101:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529263.360111:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.360120:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.360136:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34400) 00010000:00010000:0.0:1782529263.360139:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782529263.360158:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.360167:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eac92b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782529263.361545:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782529263.361676:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1782529263.361691:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325273857104ns, next at 326273853809ns, rc = 0 00000001:00080000:0.0:1782529263.361700:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1782529263.361761:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34400) 00010000:00010000:0.0:1782529263.361765:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782529263.361775:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac916 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0d1 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529263.361917:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c66575a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:11583:x1869117108869760:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 30431us (30939us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1782529263.361935:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000020:00080000:0.0:1782529263.361939:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782529263.374279:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529263.374352:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108870016 00000100:00100000:1.0:1782529263.374361:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108870016 00000100:00100000:1.0:1782529263.374416:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 203 00000100:00100000:1.0:1782529263.374427:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+50:11583:x1869117108870016:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529263.374451:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529263.374474:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac932 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0d8 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.374535:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac932 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0d8 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.374550:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac932 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0d8 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.374569:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:1.0:1782529263.374572:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782529263.374576:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7e00, rc 0) 00000100:00100000:1.0:1782529263.374651:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+51:11583:x1869117108870016:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 226us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529263.374658:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 203 00000100:00100000:2.0:1782529263.381680:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.381778:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108870272 00000100:00100000:0.0:1782529263.381789:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108870272 00000100:00100000:0.0:1782529263.381900:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:0.0:1782529263.381911:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+51:11583:x1869117108870272:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1782529263.382162:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:11583:x1869117108870272:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 253us (492us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1782529263.382170:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1782529263.441058:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529263.441108:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529263.441152:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529263.441305:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108870528 00000100:00100000:1.0:1782529263.441315:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108870528 00000100:00100000:1.0:1782529263.441385:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:1.0:1782529263.441397:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108870528:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529263.441470:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2343:x1869117108870528:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529263.441478:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:0.0:1782529263.441791:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108870656 00000100:00100000:0.0:1782529263.441796:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108870656 00000100:00100000:0.0:1782529263.441871:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 157 00000100:00100000:0.0:1782529263.441880:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c660029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108870656:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529263.441917:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c660029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108870656:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 39us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529263.441923:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 157 00000100:00080000:1.0:1782529263.441991:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529263.442200:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108870400 00000100:00100000:2.0:1782529263.442205:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108870400 00000100:00100000:2.0:1782529263.442246:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 297 00000100:00100000:2.0:1782529263.442254:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108870400:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529263.442293:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6484a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108870400:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 40us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529263.442303:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 297 00000100:00100000:1.0:1782529263.499401:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.500940:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108870784 00000100:00100000:2.0:1782529263.500956:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108870784 00000100:00100000:2.0:1782529263.501043:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 204 00000100:00100000:2.0:1782529263.501053:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:11593:x1869117108870784:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1782529263.501138:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501154:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501165:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501179:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501186:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501210:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501307:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501316:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501323:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529263.501366:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501379:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501385:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501392:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501398:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529263.501402:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501409:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501421:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:2.0:1782529263.501430:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529263.501435:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501442:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac939 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501456:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501462:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501468:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501474:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529263.501477:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501484:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501491:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c669568f00) 00010000:00010000:2.0:1782529263.501494:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529263.501497:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501503:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501517:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501530:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501536:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501542:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529263.501545:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501552:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501561:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:2.0:1782529263.501563:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529263.501566:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.501571:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eac947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.502610:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:11593:x1869117108870784:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 1544us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529263.502622:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 204 00000100:00100000:3.0:1782529263.550705:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.559200:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108871040 00000100:00100000:0.0:1782529263.559215:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108871040 00000100:00100000:0.0:1782529263.559297:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 205 00000100:00100000:0.0:1782529263.559307:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+52:11596:x1869117108871040:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529263.559327:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529263.559350:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac94e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559423:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559438:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559449:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559495:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559504:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559511:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559652:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559662:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559670:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529263.559681:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782529263.559789:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559798:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559805:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559811:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ac00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529263.559816:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559867:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559889:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529263.559893:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529263.559898:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559905:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac955 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559918:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559924:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559930:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559935:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529263.559938:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559944:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559951:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529263.559953:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529263.559956:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.559971:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac95c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.560013:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac94e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.560027:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.560035:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529263.560038:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529263.560041:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682171e00, rc 0) 00000100:00100000:1.0:1782529263.571095:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:11596:x1869117108871040:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 11777us (20395us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1782529263.571108:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 205 00000100:00100000:1.0:1782529263.575974:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.576071:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108871168 00000100:00100000:2.0:1782529263.576084:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108871168 00000100:00100000:2.0:1782529263.576151:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 206 00000100:00100000:2.0:1782529263.576162:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:11596:x1869117108871168:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:2.0:1782529263.576230:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576256:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576265:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576289:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576293:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576298:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576302:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529263.576305:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576309:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576317:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:2.0:1782529263.576319:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782529263.576324:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.576329:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.576420:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:11596:x1869117108871168:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 259us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529263.576432:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 206 00000100:00100000:2.0:1782529263.579649:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.579761:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108871424 00000100:00100000:0.0:1782529263.579774:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108871424 00000100:00100000:0.0:1782529263.579867:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:0.0:1782529263.579878:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+54:11596:x1869117108871424:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1782529263.580154:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11596:x1869117108871424:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 276us (510us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1782529263.580162:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:3.0:1782529263.669737:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.669873:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108871680 00000100:00100000:2.0:1782529263.669887:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108871680 00000100:00100000:2.0:1782529263.669966:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 207 00000100:00100000:2.0:1782529263.669979:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11606:x1869117108871680:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529263.670015:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529263.670020:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782529263.670057:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac8f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0c3 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.670081:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:2.0:1782529263.670087:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529263.670105:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac978 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0e6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.670269:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.670286:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.670295:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.670338:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.670376:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 55 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.670393:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117247744:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529263.670521:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6584c1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529263.676537:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.676754:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117247744:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529263.676790:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529263.677014:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108871808 00000100:00100000:3.0:1782529263.677025:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108871808 00010000:00010000:3.0:1782529263.677079:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 56 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529263.677147:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:3.0:1782529263.677158:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+56:2344:x1869117108871808:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529263.677179:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529263.677188:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 56 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.677201:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 56 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.677241:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0df expref: 56 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.677260:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:3.0:1782529263.677266:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.677278:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.677286:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.677322:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529263.677408:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:2344:x1869117108871808:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 250us (885us total) trans 0 rc 0/0 00010000:00010000:0.0:1782529263.677417:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529263.677419:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 79 00010000:00010000:0.0:1782529263.677437:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529263.677467:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782529263.677935:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac978 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.677980:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.677990:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529263.677993:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782529263.677996:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01c00, rc 0) 00000100:00100000:0.0:1782529263.678065:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11606:x1869117108871680:12345-192.168.202.50@tcp:101:bash.0 Request processed in 8088us (8352us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1782529263.678075:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 207 00000100:00100000:1.0:1782529263.683246:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.683359:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108872064 00000100:00100000:2.0:1782529263.683373:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108872064 00000100:00100000:2.0:1782529263.683464:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 208 00000100:00100000:2.0:1782529263.683476:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+55:11606:x1869117108872064:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:2.0:1782529263.684161:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.684185:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.684199:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529263.684268:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1782529263.684297:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000173baf74 reply state 00000000e8ded0f1 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.684308:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529263.684807:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11606:x1869117108872064:12345-192.168.202.50@tcp:36:bash.0 Request processed in 1328us (1571us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1782529263.684818:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 208 00000020:00080000:2.0:1782529263.684825:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782529263.687668:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.687689:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.687698:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.687704:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529263.687710:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.687931:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.687961:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:2.0:1782529263.687967:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529263.687973:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.687979:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac98d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529263.690408:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.690557:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108872192 00000100:00100000:2.0:1782529263.690571:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108872192 00000100:00100000:2.0:1782529263.690660:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 209 00000100:00100000:2.0:1782529263.690671:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11606:x1869117108872192:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529263.690733:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529263.690764:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac994 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.690920:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.690937:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.690946:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.690989:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.691002:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 58 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.691021:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fb63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117247872:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529263.691142:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6584c1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529263.694370:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.694472:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108872320 00000100:00100000:0.0:1782529263.694489:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108872320 00010000:00010000:0.0:1782529263.694546:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 59 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529263.694653:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fb63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117247872:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529263.694689:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 80 00010000:00010000:2.0:1782529263.694694:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529263.694707:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:2341:x1869117108872320:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529263.695159:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529263.695170:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 59 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.695186:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 59 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.695212:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01c00/0x72bfdc08f7eac97f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0e6 expref: 59 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.695251:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529263.695257:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.695266:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.695275:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.695309:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529263.695378:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:2341:x1869117108872320:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 678us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529263.695386:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 80 00010000:00010000:2.0:1782529263.696090:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.696104:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529263.696196:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782529263.696201:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529263.696240:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.696288:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eac994 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.696309:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.696317:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:2.0:1782529263.696320:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529263.696324:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529263.696404:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11606:x1869117108872192:12345-192.168.202.50@tcp:101:bash.0 Request processed in 5733us (6008us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529263.696414:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 209 00000100:00100000:3.0:1782529263.701573:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.702009:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108872576 00000100:00100000:0.0:1782529263.702025:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108872576 00000100:00100000:0.0:1782529263.702120:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:0.0:1782529263.702132:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+57:11606:x1869117108872576:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:0.0:1782529263.702509:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11606:x1869117108872576:12345-192.168.202.50@tcp:35:bash.0 Request processed in 377us (949us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1782529263.702519:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:1.0:1782529263.785284:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.785414:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108872704 00000100:00100000:0.0:1782529263.785429:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108872704 00000100:00100000:0.0:1782529263.785510:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 210 00000100:00100000:0.0:1782529263.785523:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+58:11612:x1869117108872704:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529263.785557:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529263.785620:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0f4 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.785709:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac9a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.785903:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.785920:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529263.786007:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1782529263.786011:0:6616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529263.786042:0:6616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.786076:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0f4 expref: 60 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.786100:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0f4 expref: 59 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.786111:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529263.786115:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782529263.786120:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170a00, rc 0) 00000100:00100000:0.0:1782529263.786212:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11612:x1869117108872704:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 692us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529263.786221:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 210 00000100:00100000:1.0:1782529263.794522:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.794749:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108872832 00000100:00100000:0.0:1782529263.794771:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108872832 00000100:00100000:0.0:1782529263.794881:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 211 00000100:00100000:0.0:1782529263.794893:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11612:x1869117108872832:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529263.794922:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529263.794949:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae0fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795034:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795054:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795067:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795084:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795091:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795096:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795255:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795265:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795279:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529263.795336:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782529263.795341:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529263.795366:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795509:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795521:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795528:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795537:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795543:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529263.795548:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795557:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795572:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529263.795575:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529263.795580:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795586:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795632:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795637:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795643:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795647:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529263.795651:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795656:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795664:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529263.795666:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529263.795670:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795675:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795715:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795730:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.795753:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529263.795755:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529263.795758:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972b200, rc 0) 00000100:00100000:0.0:1782529263.796045:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11612:x1869117108872832:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1152us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529263.796054:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 211 00000100:00100000:2.0:1782529263.802475:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.802569:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108873088 00000100:00100000:0.0:1782529263.802582:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108873088 00000100:00100000:0.0:1782529263.802671:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 212 00000100:00100000:0.0:1782529263.802683:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11612:x1869117108873088:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529263.802711:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529263.802752:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae102 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.802942:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.802962:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.802971:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.802980:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.803027:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.803062:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 61 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529263.803079:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117248000:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529263.803238:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.803249:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 61 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529263.803259:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117248128:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529263.803286:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6806ce840 going to sleep for 11 seconds 00000100:00100000:1.0:1782529263.806622:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529263.806826:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108873216 00000100:00100000:3.0:1782529263.806886:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108873216 00010000:00010000:3.0:1782529263.806945:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 62 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529263.806995:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:3.0:1782529263.807006:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650286c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:2341:x1869117108873216:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529263.807025:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529263.807033:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 62 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.807046:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 62 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.807076:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:3.0:1782529263.807082:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.807092:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.807099:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529263.807183:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650286c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:2341:x1869117108873216:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 178us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529263.807192:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 81 00010000:00010000:0.0:1782529263.810997:0:6616:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.50@tcp) returned -22 from blocking AST (req@000000003285861f x1869117117248000) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 61 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.811031:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eac9c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0fb expref: 61 pid: 5794 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529263.811054:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117248000:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529263.811071:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6616:1869117117248128:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529263.811103:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529263.811109:0:6616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.811277:0:6616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.811287:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529263.814432:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529263.814901:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108873344 00000100:00100000:3.0:1782529263.814915:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108873344 00010000:00010000:3.0:1782529263.814973:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 61 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529263.815043:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:3.0:1782529263.815055:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:2343:x1869117108873344:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529263.815075:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529263.815083:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 61 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.815098:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 61 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.815127:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eac99b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0ed expref: 61 pid: 5796 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.815150:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:3.0:1782529263.815156:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.815168:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.815176:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529263.815920:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529263.816008:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:2343:x1869117108873344:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 950us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529263.816020:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 82 00010000:00010000:1.0:1782529263.816445:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.816456:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529263.816483:0:6616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782529263.816716:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 61 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.816750:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 60 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529263.816757:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:1.0:1782529263.816760:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782529263.816764:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972ac00, rc 0) 00000100:00100000:1.0:1782529263.816828:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11612:x1869117108873088:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 14148us (14370us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1782529263.816876:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 212 00000100:00100000:1.0:1782529263.821915:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.822179:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108873600 00000100:00100000:2.0:1782529263.822193:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108873600 00000100:00100000:2.0:1782529263.822293:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1782529263.822305:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11612:x1869117108873600:12345-192.168.202.50@tcp:103:lfs.0 00010000:00010000:2.0:1782529263.822330:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529263.822366:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7e00/0x72bfdc08f7eac932 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0d8 expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.822396:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:2.0:1782529263.822430:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529263.822529:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11612:x1869117108873600:12345-192.168.202.50@tcp:103:lfs.0 Request processed in 225us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529263.822539:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1782529263.825992:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529263.826471:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108873728 00000100:00100000:0.0:1782529263.826484:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108873728 00000100:00100000:0.0:1782529263.826593:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 213 00000100:00100000:0.0:1782529263.826621:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11612:x1869117108873728:12345-192.168.202.50@tcp:58:lfs.0 00010000:00010000:0.0:1782529263.826770:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.826791:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529263.826806:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782529263.827098:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1782529263.827471:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11612:x1869117108873728:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 849us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529263.827481:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 213 00000100:00100000:1.0:1782529263.830158:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529263.830575:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108873856 00000100:00100000:2.0:1782529263.830588:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108873856 00000100:00100000:2.0:1782529263.830674:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 214 00000100:00100000:2.0:1782529263.830686:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+59:11612:x1869117108873856:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529263.830713:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529263.830750:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae109 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.830827:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.830862:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae109 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.830885:0:5796:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.830901:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae109 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.830917:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:2.0:1782529263.830921:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782529263.830924:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae109 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529263.830951:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00a00, rc 0) 00000100:00100000:2.0:1782529263.831015:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11612:x1869117108873856:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 332us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529263.831024:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 214 00010000:00010000:0.0:1782529264.071254:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529264.199641:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117248256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529264.199746:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529264.199945:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117248256 00000100:00100000:3.0:1782529264.199972:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117248256 00000100:00100000:3.0:1782529264.200042:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782529264.200054:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1869117117248256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529264.200089:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529264.200160:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1869117117248256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529264.200168:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782529264.200747:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117248256:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1782529264.584508:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529264.584524:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529264.584609:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1782529264.584640:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782529264.584813:0:11551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117248384:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782529264.585243:0:11551:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646066540 going to sleep for 11 seconds 00000100:00100000:3.0:1782529264.591072:0:11551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117248384:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782529264.592602:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529264.592797:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108873984 00000100:00100000:1.0:1782529264.592816:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108873984 00000100:00100000:1.0:1782529264.592914:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 215 00000100:00100000:1.0:1782529264.592923:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11613:x1869117108873984:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782529264.592955:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782529264.593058:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11613:x1869117108873984:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 135us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529264.593066:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 215 00000100:00080000:2.0:1782529264.593123:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529264.601466:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.601709:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108874112 00000100:00100000:0.0:1782529264.601720:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108874112 00000100:00100000:0.0:1782529264.601780:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 216 00000100:00100000:0.0:1782529264.601790:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11613:x1869117108874112:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782529264.601895:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.601913:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.601926:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602173:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602183:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602191:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602216:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602225:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602232:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529264.602268:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782529264.602272:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529264.602284:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602295:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602308:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602315:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602321:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529264.602325:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602333:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602344:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:0.0:1782529264.602347:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529264.602352:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602358:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eac9ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602372:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602378:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602384:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602389:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529264.602398:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602405:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602412:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff99c642b0fc00) 00010000:00010000:0.0:1782529264.602415:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529264.602418:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602423:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eac9f6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602438:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602444:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602450:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602456:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972bc00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529264.602459:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602465:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602471:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529264.602473:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529264.602481:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.602487:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eac9fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529264.602767:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11613:x1869117108874112:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 977us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529264.602775:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 216 00000100:00100000:3.0:1782529264.614497:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529264.615233:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108874368 00000100:00100000:1.0:1782529264.615249:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108874368 00000100:00100000:1.0:1782529264.615325:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 217 00000100:00100000:1.0:1782529264.615336:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+60:11613:x1869117108874368:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782529264.615966:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529264.615991:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eaca04 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae110 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616106:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616122:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616150:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529264.616162:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782529264.616260:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616269:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616277:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616283:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529264.616288:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616296:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616308:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:1.0:1782529264.616311:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782529264.616315:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.616321:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7600/0x72bfdc08f7eaca0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.619292:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eaca04 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae110 expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.619335:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:1.0:1782529264.619337:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782529264.619354:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6400/0x72bfdc08f7eaca04 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae110 expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.619372:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6400, rc 0) 00000100:00100000:1.0:1782529264.619447:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11613:x1869117108874368:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 4110us (4961us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1782529264.619464:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 217 00000100:00100000:2.0:1782529264.632003:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529264.632203:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108874496 00000100:00100000:3.0:1782529264.632217:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108874496 00000100:00100000:3.0:1782529264.632299:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 218 00000100:00100000:3.0:1782529264.632314:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11613:x1869117108874496:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782529264.632367:0:5795:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782529264.632560:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11613:x1869117108874496:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 250us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529264.632569:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 218 00000100:00100000:2.0:1782529264.645437:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.646183:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108874752 00000100:00100000:0.0:1782529264.646200:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108874752 00000100:00100000:0.0:1782529264.646337:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 219 00000100:00100000:0.0:1782529264.646349:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11613:x1869117108874752:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529264.646383:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529264.646388:0:6616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782529264.646424:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170a00/0x72bfdc08f7eac9a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae0f4 expref: 61 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.646453:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529264.646459:0:6616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782529264.646479:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae117 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782529264.647354:0:6616:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1782529264.649342:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eaca20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.649372:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eaca20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.649412:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eaca20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.649517:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae117 expref: 63 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.649544:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eaca20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae117 expref: 62 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.649555:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:0.0:1782529264.649559:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529264.649563:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972b200, rc 0) 00000100:00100000:0.0:1782529264.649679:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11613:x1869117108874752:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 3330us (4258us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1782529264.649690:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 219 00000100:00100000:1.0:1782529264.653685:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529264.654070:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108875008 00000100:00100000:3.0:1782529264.654082:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108875008 00000100:00100000:3.0:1782529264.654200:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 220 00000100:00100000:3.0:1782529264.654219:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11613:x1869117108875008:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782529264.654324:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529264.654363:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972b200/0x72bfdc08f7eaca20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae117 expref: 62 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654389:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c642b0fc00) 00010000:00010000:3.0:1782529264.654406:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782529264.654439:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654454:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654463:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654476:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654480:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654484:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654587:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654605:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654611:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654624:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529264.654629:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654637:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654647:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:3.0:1782529264.654650:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529264.654655:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654659:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045600/0x72bfdc08f7eaca2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654668:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654671:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654676:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654679:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529264.654680:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654683:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654698:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x99b211bd (ffff99c6601f9700) 00010000:00010000:3.0:1782529264.654700:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529264.654702:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.654706:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x99b211bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529264.654813:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11613:x1869117108875008:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 597us (1144us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782529264.654819:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 220 00000100:00100000:1.0:1782529264.658272:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529264.658399:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108875136 00000100:00100000:2.0:1782529264.658413:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108875136 00000100:00100000:2.0:1782529264.658530:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 221 00000100:00100000:2.0:1782529264.658543:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+61:11613:x1869117108875136:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782529264.658571:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529264.658626:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae11e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.658677:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.658695:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.658720:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.658946:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 63 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.658969:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.658980:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:2.0:1782529264.658984:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782529264.658988:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00200, rc 0) 00000100:00100000:2.0:1782529264.659063:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11613:x1869117108875136:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 523us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529264.659071:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 221 00000100:00100000:1.0:1782529264.665385:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529264.665514:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108875392 00000100:00100000:2.0:1782529264.665529:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108875392 00000100:00100000:2.0:1782529264.665744:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 222 00000100:00100000:2.0:1782529264.665758:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+62:11613:x1869117108875392:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782529264.665970:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.665993:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.666009:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782529264.666372:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1782529264.666385:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326578550693ns, next at 327578547475ns, rc = 0 00000004:00010000:2.0:1782529264.666520:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025d324f7 reply state 0000000032c202a5 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529264.666529:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529264.674053:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+64:11613:x1869117108875392:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 8277us (8663us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1782529264.674073:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 222 00010000:00010000:2.0:1782529264.680421:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.680445:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.680454:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.680461:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529264.680468:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.680476:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.680498:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:2.0:1782529264.680502:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782529264.680508:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.680514:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529264.681146:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.681954:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108875520 00000100:00100000:0.0:1782529264.681970:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108875520 00000100:00100000:0.0:1782529264.682051:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 223 00000100:00100000:0.0:1782529264.682062:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+63:11613:x1869117108875520:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529264.682095:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529264.682122:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae125 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.683347:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 64 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.683380:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 64 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.683445:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:0.0:1782529264.683448:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529264.683453:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972bc00, rc 0) 00000100:00100000:0.0:1782529264.683548:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+64:11613:x1869117108875520:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1487us (2409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529264.683557:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 223 00000100:00100000:1.0:1782529264.688924:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529264.689041:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108875648 00000100:00100000:2.0:1782529264.689077:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108875648 00000100:00100000:2.0:1782529264.689208:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:2.0:1782529264.689221:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108875648:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782529264.689686:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2344:x1869117108875648:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 466us (980us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1782529264.689695:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00080000:1.0:1782529264.693998:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529264.697990:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.698120:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108875904 00000100:00100000:0.0:1782529264.698145:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108875904 00000100:00100000:0.0:1782529264.698229:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:0.0:1782529264.698241:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+64:11613:x1869117108875904:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782529264.698569:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+65:11613:x1869117108875904:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 329us (593us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1782529264.698579:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:3.0:1782529264.702887:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529264.703825:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108876160 00000100:00100000:2.0:1782529264.703872:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108876160 00000100:00100000:2.0:1782529264.703965:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 224 00000100:00100000:2.0:1782529264.703978:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+65:11613:x1869117108876160:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782529264.704512:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+65:11613:x1869117108876160:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 534us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529264.704523:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 224 00000100:00100000:1.0:1782529264.711689:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529264.711783:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108876288 00000100:00100000:2.0:1782529264.711798:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108876288 00000100:00100000:2.0:1782529264.712000:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 225 00000100:00100000:2.0:1782529264.712013:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+65:11613:x1869117108876288:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782529264.712043:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529264.712071:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae12c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.712179:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.712205:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.712244:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529264.712299:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529264.712320:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.712352:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eaca58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae12c expref: 67 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.712445:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae12c expref: 66 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.712456:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:2.0:1782529264.712459:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782529264.712463:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529264.712549:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+66:11613:x1869117108876288:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 538us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529264.712558:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 225 00000100:00100000:1.0:1782529264.719454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.719558:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108876416 00000100:00100000:0.0:1782529264.719572:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108876416 00000100:00100000:0.0:1782529264.719663:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:0.0:1782529264.719677:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+10:2343:x1869117108876416:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529264.719704:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529264.719736:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae133 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782529264.719775:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3f3cf1, blocks: 0x1 00010000:00010000:0.0:1782529264.719803:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1782529264.719809:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529264.719896:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 11 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.719924:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 11 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529264.719941:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c65972b200, rc 0) 00000100:00100000:0.0:1782529264.720013:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:2343:x1869117108876416:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 339us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529264.720021:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:3.0:1782529264.724462:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.733449:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108876672 00000100:00100000:0.0:1782529264.733474:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108876672 00000100:00100000:0.0:1782529264.734077:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 226 00000100:00100000:0.0:1782529264.734093:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+66:11613:x1869117108876672:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782529264.734351:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+66:11613:x1869117108876672:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 260us (9903us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529264.734360:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 226 00000100:00100000:1.0:1782529264.741041:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529264.741472:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108876800 00000100:00100000:3.0:1782529264.741490:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108876800 00000100:00100000:3.0:1782529264.741629:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:3.0:1782529264.741642:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:11613:x1869117108876800:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529264.741669:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529264.741696:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae13a expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.741740:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 12 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.741751:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529264.741757:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529264.741783:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.741885:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 12 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.741903:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 12 pid: 6593 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529264.741923:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6591:1869117117248512:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529264.742055:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6460666c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529264.753431:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6591:1869117117248512:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529264.753485:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.753513:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045000, rc 0) 00000100:00100000:3.0:1782529264.753606:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:11613:x1869117108876800:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 11965us (12579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529264.753617:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:3.0:1782529264.762533:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.762633:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108876928 00000100:00100000:0.0:1782529264.762648:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108876928 00010000:00010000:0.0:1782529264.762713:0:8316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 12 pid: 6593 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529264.762782:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:0.0:1782529264.762794:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:2343:x1869117108876928:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529264.762816:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529264.763601:0:8316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 12 pid: 6593 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.763621:0:8316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 12 pid: 6593 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.763657:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5f12bb1/0x72bfdc08f7eaca66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae133 expref: 12 pid: 6593 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.763696:0:8316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529264.763702:0:8316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529264.763713:0:8316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.763725:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.763782:0:8316:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529264.763802:0:8316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677335180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8316:1869117117248640:192.168.202.50@tcp:105: 00000100:00100000:2.0:1782529264.763971:0:8316:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6584c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1782529264.770014:0:8316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677335180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8316:1869117117248640:192.168.202.50@tcp:105: 00010000:00010000:2.0:1782529264.770049:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529264.770137:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:2343:x1869117108876928:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 7337us (7614us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529264.770151:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:0.0:1782529264.775072:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529264.775194:0:6596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108877056 00000100:00100000:1.0:1782529264.775217:0:6596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108877056 00002000:00100000:1.0:1782529264.775284:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff99c67fae5f80 x1869117108877056/t0(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:700/0 lens 504/0 e 0 to 0 dl 1782529275 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782529264.775297:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fae5f80 with x1869117108877056 ext(0->12) 00002000:00010000:1.0:1782529264.775303:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67fae5f80 00000100:00100000:1.0:1782529264.775343:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1782529264.775354:0:6596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+11:2344:x1869117108877056:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1782529264.777518:0:6596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:2344:x1869117108877056:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 Request processed in 2151us (2449us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1782529264.777533:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00002000:00100000:1.0:1782529264.777548:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff99c67fae5f80 x1869117108877056/t4294967320(0) o4->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:700/0 lens 504/448 e 0 to 0 dl 1782529275 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782529264.777560:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c67fae5f80 with x1869117108877056 ext(0->12) 00002000:00010000:1.0:1782529264.777567:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c67fae5f80 00000100:00100000:3.0:1782529264.781680:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.781883:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108877184 00000100:00100000:0.0:1782529264.781897:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108877184 00000100:00100000:0.0:1782529264.781973:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 227 00000100:00100000:0.0:1782529264.781984:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+66:11613:x1869117108877184:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782529264.880081:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1782529264.880142:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1782529264.880169:0:5816:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99c6806cef00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1782529264.880176:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6502b5500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99c6806cecc0 00000020:00080000:3.0:1782529264.880179:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6502b5e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99c646902000 00000004:00080000:3.0:1782529264.880267:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1782529264.880288:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1782529264.880292:0:5816:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99c6461b0a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1782529264.880295:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c646154e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99c6461b0900 00000020:00080000:3.0:1782529264.880298:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c646154c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99c67fb8e800 00000004:00080000:3.0:1782529264.880311:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1782529264.880316:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1782529264.880548:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1782529264.880567:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117248768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782529264.880673:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529264.880760:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782529264.880767:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117248896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782529264.880792:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529264.880877:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117248768 00000100:00100000:3.0:1782529264.880886:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117248768 00000100:00100000:3.0:1782529264.880948:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117248896 00000100:00100000:3.0:1782529264.880952:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117248896 00000100:00100000:3.0:1782529264.880974:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782529264.880983:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1869117117248768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782529264.881018:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1782529264.881052:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.881080:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 12 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.881090:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782529264.881094:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529264.881099:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.881149:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 12 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.881164:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 12 pid: 6593 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529264.881178:0:6592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6592:1869117117249024:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529264.881250:0:6592:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646066cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1782529264.881264:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529264.881281:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782529264.881289:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3294:x1869117117248896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782529264.881477:0:8328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782529264.881480:0:8328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782529265 00002000:00010000:3.0:1782529264.881483:0:8328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782529264.881485:0:8328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782529265 -> 1782529265 00002000:00010000:3.0:1782529264.881487:0:8328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782529264.881535:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1869117117248896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 246us (741us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1782529264.881544:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1782529264.881742:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c67831a680/2, rc 0, transno 4294967321 00000100:00100000:3.0:1782529264.881749:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117248896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782529264.881781:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11613:x1869117108877184:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 99797us (100116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529264.881790:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 227 00000100:00100000:0.0:1782529264.882435:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117249152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782529264.882495:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529264.882611:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117249152 00000100:00100000:1.0:1782529264.882618:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117249152 00000100:00100000:1.0:1782529264.882672:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782529264.882681:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3296:x1869117117249152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782529264.882707:0:8328:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1782529264.882757:0:8328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3f3cef, atime: 0x6a3f3cef, ctime: 0x6a3f3cef, blocks: 0x1 00010000:00010000:1.0:1782529264.882765:0:8328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.882782:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1782529264.882787:0:8328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529264.882795:0:8328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.882813:0:8328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.882886:0:8328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.882894:0:8328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.883086:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782529264.883813:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529264.883824:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.883858:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529264.883863:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.883882:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.883904:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.883922:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009067fb1c/0x72bfdc08f7eaca7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.883951:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529264.883953:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529264.883955:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529264.884562:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1869117117249152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1876us (2061us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782529264.884574:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782529264.885751:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529264.886113:0:6592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6592:1869117117249024:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529264.886149:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529264.887125:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108877312 00000100:00100000:2.0:1782529264.887139:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108877312 00010000:00010000:2.0:1782529264.887201:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 13 pid: 6593 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529264.887246:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:2.0:1782529264.887257:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+13:2344:x1869117108877312:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529264.887280:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529264.887287:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 13 pid: 6593 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.887301:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 13 pid: 6593 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.887356:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa855f01/0x72bfdc08f7eac836 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae099 expref: 13 pid: 6593 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.887377:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529264.887382:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529264.887389:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.887399:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.887441:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529264.887517:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:2344:x1869117108877312:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 261us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529264.887527:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 84 00010000:00010000:3.0:1782529264.888949:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.888993:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.889007:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.889019:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529264.889108:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782529264.889821:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529264.889870:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.889883:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529264.889889:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.889901:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.889955:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.889963:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caceff1f/0x72bfdc08f7eaca74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.889992:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529264.889993:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529264.889995:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529264.890275:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3294:x1869117117248768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9287us (9598us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1782529264.890287:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1782529264.890548:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c677335180/2, rc 0, transno 4294967310 00000100:00100000:0.0:1782529264.890561:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117249152:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1782529264.893748:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c67831b100/2, rc 0, transno 4294967322 00000100:00100000:3.0:1782529264.893771:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117248768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782529264.894073:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529264.894165:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108877440 00000100:00100000:0.0:1782529264.894175:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108877440 00000100:00100000:0.0:1782529264.894244:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:0.0:1782529264.894256:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+12:2343:x1869117108877440:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1782529264.973291:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1782529264.973314:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1782529264.974890:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108877440:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 80576us (80760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529264.974910:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:3.0:1782529264.980900:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529264.981420:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108877696 00000100:00100000:2.0:1782529264.981436:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108877696 00000100:00100000:2.0:1782529264.981510:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 228 00000100:00100000:2.0:1782529264.981522:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11613:x1869117108877696:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782529264.981623:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529264.981661:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae12c expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.981687:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:2.0:1782529264.981693:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529264.981740:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.981759:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529264.981794:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529264.982193:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073e26d3d reply state 00000000f8a92600 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529264.982218:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529264.982363:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:11613:x1869117108877696:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 841us (1476us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1782529264.982374:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 228 00010000:00010000:3.0:1782529264.987017:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.987040:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.987047:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.987055:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529264.987062:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.987071:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.987114:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:3.0:1782529264.987117:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529264.987123:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.987140:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00400/0x72bfdc08f7eaca82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529264.987424:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529264.987980:0:8328:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108877824 00000100:00100000:3.0:1782529264.987994:0:8328:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108877824 00000100:00100000:3.0:1782529264.988081:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:3.0:1782529264.988093:0:8328:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108877824:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782529264.988470:0:8328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1782529264.988475:0:8328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1782529265 -> 1782529264 00002000:00010000:3.0:1782529264.988478:0:8328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782529263 00002000:00010000:3.0:1782529264.988480:0:8328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782529265 -> 1782529264 00002000:00010000:3.0:1782529264.988482:0:8328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1782529264.988563:0:8328:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2344:x1869117108877824:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 471us (1145us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1782529264.988572:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:2.0:1782529264.995052:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529264.995311:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108878080 00000100:00100000:3.0:1782529264.995325:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108878080 00000100:00100000:3.0:1782529264.995413:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 229 00000100:00100000:3.0:1782529264.995426:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:11613:x1869117108878080:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782529264.995531:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.995574:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.995584:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.995643:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529264.995660:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 20 pid: 5796 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529264.995679:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117249280:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529264.995811:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6460660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529265.006928:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529265.011385:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108878208 00000100:00100000:1.0:1782529265.011405:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108878208 00010000:00010000:1.0:1782529265.011478:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 21 pid: 5796 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529265.011530:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:1.0:1782529265.011562:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:2343:x1869117108878208:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529265.011596:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529265.011611:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 21 pid: 5796 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.011628:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 21 pid: 5796 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.011658:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:1.0:1782529265.011664:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.011676:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.011686:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.011714:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529265.011794:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:2343:x1869117108878208:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 233us (4881us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529265.011802:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 85 00010000:00010000:3.0:1782529265.014189:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00200/0x72bfdc08f7eaca43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae11e expref: 20 pid: 5796 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529265.014272:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869117117249280:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529265.014302:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.016987:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.017011:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.017059:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.017068:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.017076:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.017084:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529265.017090:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.017314:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.017339:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:2.0:1782529265.017343:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1782529265.017350:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.017357:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045400/0x72bfdc08f7eaca89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529265.017856:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:11613:x1869117108878080:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 Request processed in 22401us (22790us total) trans 0 rc -22/-22 00000100:00100000:2.0:1782529265.017870:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 229 00000100:00100000:1.0:1782529265.040999:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529265.041974:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108878336 00000100:00100000:0.0:1782529265.041992:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108878336 00000100:00100000:0.0:1782529265.042081:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:0.0:1782529265.042094:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2343:x1869117108878336:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782529265.042474:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.042519:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.042529:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529265.042533:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782529265.042538:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.042617:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.042636:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 8 pid: 6591 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529265.042656:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6591:1869117117249408:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529265.042868:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6456a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1782529265.056160:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529265.056341:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108878464 00000100:00100000:1.0:1782529265.056354:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108878464 00010000:00010000:1.0:1782529265.056422:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 9 pid: 6591 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529265.056470:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:1.0:1782529265.056500:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108878464:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529265.056523:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529265.056553:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 9 pid: 6591 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.056570:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 9 pid: 6591 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.056623:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782529265.056628:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782529265.056634:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.056645:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.056670:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529265.056737:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+9:2344:x1869117108878464:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 238us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529265.056746:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 86 00010000:00010000:3.0:1782529265.057532:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2bdb8d/0x72bfdc08f7eaca6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae13a expref: 8 pid: 6591 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529265.057553:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6591:1869117117249408:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529265.057579:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057625:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057633:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057668:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057676:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057685:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057692:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:3.0:1782529265.057696:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057705:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057723:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.057740:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000055ccf4b/0x72bfdc08f7eaca90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529265.057828:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2343:x1869117108878336:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 15737us (16845us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529265.057861:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:2.0:1782529265.069089:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529265.069321:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108878720 00000100:00100000:3.0:1782529265.069335:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108878720 00000100:00100000:3.0:1782529265.070055:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 230 00000100:00100000:3.0:1782529265.070072:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:11613:x1869117108878720:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782529265.070193:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.070220:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.070235:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.073812:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.073865:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 20 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.073877:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.073934:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 20 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.073955:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 20 pid: 6616 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529265.073990:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677334380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117249536:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529265.074182:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6453cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1782529265.084340:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677334380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117249536:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529265.084390:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529265.084940:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529265.085212:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108878848 00000100:00100000:1.0:1782529265.085223:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108878848 00010000:00010000:1.0:1782529265.085273:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 21 pid: 6616 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529265.085311:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:1.0:1782529265.085322:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650287850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:2343:x1869117108878848:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529265.085360:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529265.085483:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 21 pid: 6616 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.085497:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 21 pid: 6616 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.085526:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972bc00/0x72bfdc08f7eaca51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae125 expref: 21 pid: 6616 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.085546:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:1.0:1782529265.085552:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.085563:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.085571:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.085716:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529265.085793:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650287850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:2343:x1869117108878848:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 471us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529265.085802:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 87 00010000:00010000:2.0:1782529265.086613:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.086626:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782529265.086922:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1782529265.087117:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1782529265.087170:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1782529265.087297:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677334380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869117117249664:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782529265.088884:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529265.088963:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fef3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529265.089084:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117249664 00000100:00100000:3.0:1782529265.089097:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117249664 00000100:00100000:3.0:1782529265.089182:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782529265.089478:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1869117117249664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782529265.090876:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1869117117249664:12345-0@lo:1000:mdt00_001.0 Request processed in 1674us (3497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529265.090891:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1782529265.095162:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529265.096690:0:5795:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1782529265.096706:0:5795:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1782529265.096736:0:5795:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c67831a680, transno 4294967321 00000004:00080000:2.0:1782529265.096753:0:5795:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c67831b100, transno 4294967322 00000100:00100000:2.0:1782529265.096766:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677334380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869117117249664:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1782529265.098053:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1782529265.098187:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677334380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869117117249792:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782529265.099460:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529265.099622:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782529265.103809:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117249792 00000100:00100000:1.0:1782529265.103902:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117249792 00000100:00100000:1.0:1782529265.104148:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782529265.104163:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1869117117249792:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782529265.104746:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1869117117249792:12345-0@lo:1000:mdt00_001.0 Request processed in 584us (5289us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1782529265.104756:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529265.104909:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677334380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869117117249792:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1782529265.104971:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.104984:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.104992:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105000:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529265.105006:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105014:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105036:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:2.0:1782529265.105039:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782529265.105045:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105051:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eaca9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105097:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105104:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105122:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105128:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682170400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529265.105132:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105139:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105149:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:2.0:1782529265.105152:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782529265.105162:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae109 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105177:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae109 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105189:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae109 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.105247:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae109 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529265.105267:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677337800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117249920:192.168.202.50@tcp:105: 00000100:00100000:2.0:1782529265.105389:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529265.112537:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677337800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869117117249920:192.168.202.50@tcp:105: 00010000:00010000:3.0:1782529265.112583:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112623:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eac9e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112673:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112695:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112710:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112725:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112732:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112738:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112745:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529265.112750:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112758:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112771:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:3.0:1782529265.112794:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529265.112799:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112804:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacaa5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112818:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112825:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112857:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112864:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529265.112868:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112874:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112883:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:3.0:1782529265.112886:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782529265.112889:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529265.112895:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eaca97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529265.113906:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529265.114088:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:11613:x1869117108878720:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 44019us (45010us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1782529265.114118:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 230 00000020:00080000:3.0:1782529265.114126:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1782529265.114233:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108878976 00000100:00100000:0.0:1782529265.114244:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108878976 00000100:00100000:0.0:1782529265.114308:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:0.0:1782529265.114319:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:11612:x1869117108878976:12345-192.168.202.50@tcp:49:lfs.0 00000100:00100000:0.0:1782529265.114452:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:11612:x1869117108878976:12345-192.168.202.50@tcp:49:lfs.0 Request processed in 135us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529265.114459:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000040:00080000:1.0:1782529265.116959:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782529265.116974:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782529265.118148:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1782529265.118168:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782529265.125029:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529265.125120:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529265.125291:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108879488 00000100:00100000:1.0:1782529265.125306:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108879488 00000100:00100000:1.0:1782529265.125401:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 231 00000100:00100000:1.0:1782529265.125414:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:11612:x1869117108879488:12345-192.168.202.50@tcp:58:lfs.0 00000040:00080000:1.0:1782529265.126003:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1782529265.126125:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:11612:x1869117108879488:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 711us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529265.126136:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 231 00000100:00100000:2.0:1782529265.126528:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108879232 00000100:00100000:2.0:1782529265.126548:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108879232 00000100:00100000:2.0:1782529265.126618:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:2.0:1782529265.126627:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c665758450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+23:11613:x1869117108879232:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782529265.127434:0:5797:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782529265.127568:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1782529265.127656:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.127680:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.127696:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.127707:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.127715:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.127721:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.127747:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782529265.127911:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c665758450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+25:11613:x1869117108879232:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 1281us (2893us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1782529265.127922:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000020:00080000:2.0:1782529265.127928:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782529265.128957:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529265.128971:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.128983:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529265.128988:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.128999:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.129022:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99c669568f00) 00010000:00010000:1.0:1782529265.129026:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782529265.129052:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.129059:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacaac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.129106:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529265.129108:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529265.129110:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529265.163505:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529265.163653:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108879616 00000100:00100000:2.0:1782529265.163670:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108879616 00000100:00100000:2.0:1782529265.163945:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 232 00000100:00100000:2.0:1782529265.163979:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+25:11615:x1869117108879616:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529265.164029:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529265.164060:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eacab3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae141 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164162:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164181:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164205:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164225:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164233:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164240:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164667:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164679:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 26 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164689:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164761:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 26 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529265.164782:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 26 pid: 6616 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529265.164801:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677334e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117250048:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529265.164948:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529265.170358:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529265.170559:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677334e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869117117250048:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529265.170610:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529265.171790:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108879872 00000100:00100000:3.0:1782529265.171805:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108879872 00000100:00100000:3.0:1782529265.172047:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:3.0:1782529265.172060:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:5559:x1869117108879872:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782529265.172653:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:5559:x1869117108879872:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 592us (2308us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1782529265.172667:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:0.0:1782529265.176677:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529265.177014:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108880000 00000100:00100000:1.0:1782529265.177028:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108880000 00010000:00010000:1.0:1782529265.177084:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 28 pid: 6616 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529265.177129:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:1.0:1782529265.177140:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:2344:x1869117108880000:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529265.177163:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529265.177171:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 28 pid: 6616 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.177188:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 28 pid: 6616 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.177217:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972ac00/0x72bfdc08f7eac9d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae102 expref: 28 pid: 6616 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.177239:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:1.0:1782529265.177244:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.177277:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.177285:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529265.177318:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782529265.177349:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177358:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529265.177420:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782529265.177425:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529265.177452:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177468:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177480:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177487:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177494:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177502:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529265.177506:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177521:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177532:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:0.0:1782529265.177535:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529265.177538:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177545:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7eacaba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177556:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177562:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177567:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177572:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529265.177575:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177581:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177669:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99c669568900) 00010000:00010000:0.0:1782529265.177672:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529265.177676:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177697:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00e00/0x72bfdc08f7eacac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177899:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7eacab3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae141 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177916:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae141 expref: 27 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529265.177933:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529265.177936:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529265.177939:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00c00, rc 0) 00000100:00100000:1.0:1782529265.177982:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+27:2344:x1869117108880000:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 842us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529265.177991:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:0.0:1782529265.178096:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:11615:x1869117108879616:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 14121us (14608us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529265.178104:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 232 00000001:00080000:2.0:1782529265.327074:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1782529265.327100:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1782529266.121270:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782529266.124036:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529266.124050:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529266.124098:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782529266.124133:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782529266.124318:0:11551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117250176:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782529266.124474:0:11551:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c649ea4540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529266.131829:0:11551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1869117117250176:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782529266.131881:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529266.132124:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108880128 00000100:00100000:0.0:1782529266.132135:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108880128 00000100:00100000:0.0:1782529266.132212:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 233 00000100:00100000:0.0:1782529266.132223:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:11626:x1869117108880128:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782529266.132258:0:6616:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782529266.132363:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:11626:x1869117108880128:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 141us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529266.132372:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 233 00000100:00080000:3.0:1782529266.132591:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529266.135036:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529266.135766:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108880384 00000100:00100000:0.0:1782529266.135776:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108880384 00000100:00100000:0.0:1782529266.137958:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 234 00000100:00100000:0.0:1782529266.137979:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+26:11626:x1869117108880384:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529266.138000:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529266.138022:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacacf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae148 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.138126:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eacad6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.138142:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eacad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.138153:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eacad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529266.138166:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782529266.138366:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacacf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae148 expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.138384:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eacad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae148 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.138392:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529266.138395:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529266.138398:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170400, rc 0) 00000100:00100000:0.0:1782529266.138826:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:11626:x1869117108880384:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 848us (3797us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1782529266.138861:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 234 00000040:00080000:1.0:1782529266.154181:0:12443:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782529266.154250:0:12443:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782529266.154297:0:12443:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782529266.154304:0:12443:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782529266.169675:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529266.169769:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529266.169819:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108880640 00000100:00100000:0.0:1782529266.169830:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108880640 00000100:00100000:0.0:1782529266.169908:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 235 00000100:00100000:0.0:1782529266.169917:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:11626:x1869117108880640:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782529266.170001:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170019:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170032:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170229:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170238:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170244:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170250:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529266.170254:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170261:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170274:0:6616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529266.170277:0:6616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782529266.170293:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170299:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682171e00/0x72bfdc08f7eacae4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529266.170445:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:11626:x1869117108880640:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 527us (779us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1782529266.170455:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 235 00000100:00100000:0.0:1782529266.170484:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108880768 00000100:00100000:0.0:1782529266.170489:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108880768 00000100:00100000:0.0:1782529266.170520:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:0.0:1782529266.170527:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:2344:x1869117108880768:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529266.170538:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529266.170552:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eacad6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae148 expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529266.170563:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529266.170566:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529266.170600:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:2344:x1869117108880768:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 74us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529266.170606:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000040:00080000:0.0:1782529266.170736:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782529266.170741:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782529266.171235:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1782529266.171246:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782529266.187480:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529266.187787:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108881024 00000100:00100000:1.0:1782529266.187796:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108881024 00000100:00100000:1.0:1782529266.187878:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:1.0:1782529266.187888:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+28:11626:x1869117108881024:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782529266.188146:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:11626:x1869117108881024:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 258us (675us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1782529266.188154:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:1.0:1782529266.759343:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529266.759367:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117250304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529266.759438:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529266.759706:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117250304 00000100:00100000:2.0:1782529266.759715:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117250304 00000100:00100000:2.0:1782529266.761030:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782529266.761045:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1869117117250304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529266.761089:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529266.761161:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1869117117250304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529266.761169:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782529266.761272:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117250304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529266.764718:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117250816:0@lo:400:kworker.0 00000100:00100000:3.0:1782529266.764781:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529266.764820:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529266.764825:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117250688:0@lo:400:kworker.0 00000100:00100000:3.0:1782529266.764861:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529266.764892:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117250816 00000100:00100000:3.0:1782529266.764899:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117250816 00000100:00100000:2.0:1782529266.764965:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117250432:0@lo:400:kworker.0 00000100:00100000:2.0:1782529266.764996:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529266.765014:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117250944:0@lo:400:kworker.0 00000100:00100000:2.0:1782529266.765034:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529266.765061:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782529266.765066:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117250560:0@lo:400:kworker.0 00000100:00100000:2.0:1782529266.765082:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529266.765103:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117250688 00000100:00100000:2.0:1782529266.765106:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117250688 00000100:00100000:0.0:1782529266.765161:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117250944 00000100:00100000:0.0:1782529266.765169:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117250944 00000100:00080000:1.0:1782529266.765515:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782529266.765537:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782529266.765539:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529266.765562:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117250560 00000100:00100000:1.0:1782529266.765566:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117250560 00000100:00100000:1.0:1782529266.765622:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782529266.765631:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117250560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529266.765685:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117250560:12345-0@lo:400:kworker.0 Request processed in 55us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529266.765692:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782529266.765735:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117250560:0@lo:400:kworker.0 00000100:00100000:1.0:1782529266.765762:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117250432 00000100:00100000:1.0:1782529266.765765:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117250432 00000100:00100000:1.0:1782529266.765785:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782529266.765790:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117250432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529266.765817:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117250432:12345-0@lo:400:kworker.0 Request processed in 28us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529266.765823:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782529266.765868:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117250432:0@lo:400:kworker.0 00000100:00100000:3.0:1782529266.766462:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782529266.766480:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117250816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529266.766648:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1869117117250816:12345-0@lo:400:kworker.0 Request processed in 170us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529266.766656:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782529266.766698:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117250816:0@lo:400:kworker.0 00000100:00100000:2.0:1782529266.766924:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782529266.767518:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117250688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529266.767614:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117250688:12345-0@lo:400:kworker.0 Request processed in 681us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529266.767620:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782529266.767877:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117250688:0@lo:400:kworker.0 00000100:00100000:0.0:1782529266.768227:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782529266.768239:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117250944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529266.768295:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117250944:12345-0@lo:400:kworker.0 Request processed in 58us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529266.768301:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782529266.771869:0:3294:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1782529266.771879:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c680cddf80, transno 4294967307 00000004:00080000:2.0:1782529266.771896:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1782529266.771915:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c677335180, transno 4294967310 00000100:00100000:2.0:1782529266.771922:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117250944:0@lo:400:kworker.0 00010000:00010000:1.0:1782529267.143466:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782529268.088047:0:12494:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782529268.088057:0:12494:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529268.088178:0:12494:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782529268.088198:0:12494:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782529268.170948:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529268.324232:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529268.324272:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108881280 00000100:00100000:0.0:1782529268.324282:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108881280 00000100:00100000:0.0:1782529268.324346:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 236 00000100:00100000:0.0:1782529268.324357:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+29:11647:x1869117108881280:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529268.324384:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529268.324405:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eacaeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae14f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529268.324512:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eacaf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529268.324528:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eacaf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529268.324539:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eacaf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529268.324552:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782529268.324711:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170400/0x72bfdc08f7eacaeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae14f expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529268.324728:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eacaf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae14f expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529268.324747:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:0.0:1782529268.324750:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782529268.324753:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682170000, rc 0) 00000100:00100000:0.0:1782529268.324810:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:11647:x1869117108881280:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 455us (589us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1782529268.324819:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 236 00000100:00080000:1.0:1782529268.326013:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529268.334780:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529268.334821:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108881408 00000100:00100000:1.0:1782529268.334829:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108881408 00000100:00100000:1.0:1782529268.334901:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 237 00000100:00100000:1.0:1782529268.334911:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:11647:x1869117108881408:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1782529268.334978:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335007:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335019:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335049:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335056:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335064:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335070:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529268.335074:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335081:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335094:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:1.0:1782529268.335096:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782529268.335101:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.335107:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7a00/0x72bfdc08f7eacb00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529268.335176:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+31:11647:x1869117108881408:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 266us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529268.335190:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 237 00000100:00100000:0.0:1782529268.436408:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529268.436617:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108881536 00000100:00100000:1.0:1782529268.436628:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108881536 00000100:00100000:1.0:1782529268.436719:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:1.0:1782529268.436730:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2342:x1869117108881536:12345-192.168.202.50@tcp:101:cat.0 00000100:00080000:2.0:1782529268.436854:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782529268.436940:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529268.436963:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e30d696/0x72bfdc08f7eacb07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae156 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782529268.436991:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a3f3cf0, atime: 0x6a3f3cef, ctime: 0x6a3f3cf0, blocks: 0xb 00010000:00010000:1.0:1782529268.437011:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1782529268.437015:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529268.437026:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e30d696/0x72bfdc08f7eacb07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae156 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.437045:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e30d696/0x72bfdc08f7eacb07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae156 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529268.437057:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7a00, rc 0) 00000100:00100000:1.0:1782529268.437112:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2342:x1869117108881536:12345-192.168.202.50@tcp:101:cat.0 Request processed in 385us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529268.437119:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:1.0:1782529268.446582:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529268.446679:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108881664 00000100:00100000:3.0:1782529268.446690:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108881664 00002000:00100000:3.0:1782529268.446823:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff99c647ed3800 x1869117108881664/t0(0) o3->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:704/0 lens 488/0 e 0 to 0 dl 1782529279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529268.446931:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c647ed3800 with x1869117108881664 ext(0->4095) 00002000:00010000:3.0:1782529268.446937:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c647ed3800 00000100:00100000:3.0:1782529268.447038:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1782529268.447049:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2341:x1869117108881664:12345-192.168.202.50@tcp:3:cat.0 00000100:00100000:3.0:1782529268.447444:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+8:2341:x1869117108881664:12345-192.168.202.50@tcp:3:cat.0 Request processed in 394us (870us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1782529268.447453:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00002000:00100000:3.0:1782529268.447460:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff99c647ed3800 x1869117108881664/t0(0) o3->089f7aa7-7be0-48a9-8829-cfc80cd2ee18@192.168.202.50@tcp:704/0 lens 488/4536 e 0 to 0 dl 1782529279 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782529268.447468:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99c647ed3800 with x1869117108881664 ext(0->4095) 00002000:00010000:3.0:1782529268.447487:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99c647ed3800 00000100:00100000:3.0:1782529268.558995:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529268.559034:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108881792 00000100:00100000:0.0:1782529268.559044:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108881792 00000100:00100000:0.0:1782529268.559110:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 299 00000100:00100000:0.0:1782529268.559120:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108881792:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529268.559204:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108881792:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529268.559212:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 299 00000100:00100000:0.0:1782529268.568098:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529268.568249:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529268.568331:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108881920 00000100:00100000:1.0:1782529268.568341:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108881920 00000100:00100000:1.0:1782529268.568423:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:1.0:1782529268.568434:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108881920:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529268.568503:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108881920:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529268.568511:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00080000:0.0:1782529268.568941:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529268.569197:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108882048 00000100:00100000:3.0:1782529268.569204:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108882048 00000100:00100000:3.0:1782529268.569299:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:3.0:1782529268.569308:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108882048:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529268.569405:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+5:2343:x1869117108882048:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 97us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529268.569412:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00080000:0.0:1782529268.569650:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782529269.193065:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782529269.258043:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782529269.258054:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782529269.258175:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1782529269.258183:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782529269.319628:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117251072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529269.319712:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529269.319818:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117251072 00000100:00100000:0.0:1782529269.319862:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117251072 00000100:00100000:0.0:1782529269.322088:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782529269.322105:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117251072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782529269.322146:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529269.322226:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117251072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529269.322234:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782529269.322292:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117251072:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782529269.323173:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782529269.905644:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1782529269.905677:0:5816:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1782529269.905699:0:5816:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99c646fef900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1782529269.905704:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6453c6700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99c646fef3c0 00000020:00080000:3.0:1782529269.905708:0:5816:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff99c6453c6c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99c6502f3000 00000020:00080000:3.0:1782529269.905752:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1782529269.906741:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1782529270.215169:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782529270.438588:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1782529270.438607:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:3.0:1782529271.241884:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529271.879064:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782529271.879096:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117251200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529271.879188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529271.879265:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117251200 00000100:00100000:2.0:1782529271.879274:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117251200 00000100:00100000:2.0:1782529271.879345:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782529271.879356:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117251200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529271.879423:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529271.879474:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117251200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529271.879496:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1782529271.879557:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529271.879594:0:3297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1782529271.879601:0:3297:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1782529271.879631:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117251200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529271.880668:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117251328:0@lo:400:kworker.0 00000100:00100000:0.0:1782529271.880734:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529271.880987:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117251456:0@lo:400:kworker.0 00000100:00100000:2.0:1782529271.881024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529271.881060:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782529271.881065:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117251584:0@lo:400:kworker.0 00000100:00100000:2.0:1782529271.881089:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529271.881509:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117251712:0@lo:400:kworker.0 00000100:00100000:3.0:1782529271.881557:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529271.881580:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782529271.881585:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117251840:0@lo:400:kworker.0 00000100:00100000:3.0:1782529271.881614:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529271.881649:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117251456 00000100:00100000:3.0:1782529271.881656:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117251456 00000100:00100000:3.0:1782529271.881704:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117251584 00000100:00100000:3.0:1782529271.881708:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117251584 00000100:00100000:3.0:1782529271.881747:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117251712 00000100:00100000:3.0:1782529271.881893:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117251712 00000100:00100000:3.0:1782529271.881920:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782529271.881929:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117251456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529271.881985:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117251456:12345-0@lo:400:kworker.0 Request processed in 57us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529271.881992:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782529271.882010:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782529271.882015:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117251584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529271.882040:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117251584:12345-0@lo:400:kworker.0 Request processed in 25us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529271.882046:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782529271.882055:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782529271.882061:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117251712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529271.882088:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117251712:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529271.882094:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782529271.882116:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117251840 00000100:00100000:3.0:1782529271.882120:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117251840 00000100:00100000:3.0:1782529271.882152:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782529271.882159:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117251840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529271.882189:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117251840:12345-0@lo:400:kworker.0 Request processed in 32us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529271.882195:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782529271.882244:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117251584:0@lo:400:kworker.0 00000100:00100000:3.0:1782529271.882257:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117251456:0@lo:400:kworker.0 00000100:00080000:3.0:1782529271.882295:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782529271.882301:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529271.882316:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117251840:0@lo:400:kworker.0 00000100:00100000:3.0:1782529271.882326:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117251712:0@lo:400:kworker.0 00000100:00100000:1.0:1782529271.883518:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117251328 00000100:00100000:1.0:1782529271.883566:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117251328 00000100:00100000:1.0:1782529271.883723:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1782529271.883733:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117251328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529271.884028:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117251328:12345-0@lo:400:kworker.0 Request processed in 296us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529271.884036:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1782529271.884121:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117251328:0@lo:400:kworker.0 00010000:00010000:3.0:1782529272.271764:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529273.287262:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529273.682218:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529273.682257:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529273.682289:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529273.682310:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529273.682333:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529273.682360:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108882560 00000100:00100000:3.0:1782529273.682370:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108882560 00000100:00100000:3.0:1782529273.682414:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108882432 00000100:00100000:3.0:1782529273.682417:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108882432 00000100:00100000:3.0:1782529273.682437:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:3.0:1782529273.682447:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2342:x1869117108882560:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529273.682511:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2342:x1869117108882560:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 66us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529273.682533:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:3.0:1782529273.682550:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:3.0:1782529273.682557:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2342:x1869117108882432:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529273.682582:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2342:x1869117108882432:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529273.682588:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:3.0:1782529273.682627:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108882176 00000100:00100000:3.0:1782529273.682631:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108882176 00000100:00100000:3.0:1782529273.682654:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 301 00000100:00100000:3.0:1782529273.682660:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108882176:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529273.682684:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2342:x1869117108882176:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529273.682690:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 301 00000100:00100000:3.0:1782529273.682716:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108882304 00000100:00100000:3.0:1782529273.682719:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108882304 00000100:00100000:3.0:1782529273.682741:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108882688 00000100:00100000:3.0:1782529273.682744:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108882688 00000100:00100000:3.0:1782529273.682761:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:3.0:1782529273.682767:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:2342:x1869117108882304:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529273.682794:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:2342:x1869117108882304:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529273.682800:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:3.0:1782529273.682811:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:3.0:1782529273.682817:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108882688:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529273.682865:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0893e068-92fc-4766-84ad-86afc0006669+5:2342:x1869117108882688:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 47us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529273.682871:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00080000:3.0:1782529273.682886:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782529273.682890:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782529273.682892:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529274.262953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529274.263081:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108882816 00000100:00100000:0.0:1782529274.263092:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108882816 00000100:00100000:0.0:1782529274.263162:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 238 00000100:00100000:0.0:1782529274.263172:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11279:x1869117108882816:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1782529274.263284:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11279:x1869117108882816:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 Request processed in 113us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529274.263292:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 238 00000100:00100000:3.0:1782529274.267217:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529274.267338:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108883072 00000100:00100000:2.0:1782529274.267349:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108883072 00000100:00100000:2.0:1782529274.267409:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:2.0:1782529274.267418:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:11279:x1869117108883072:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782529274.268170:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:11279:x1869117108883072:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 749us (962us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1782529274.268180:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00010000:00010000:3.0:1782529274.311297:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529274.454317:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529274.454343:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117251968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529274.454416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529274.455095:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117251968 00000100:00100000:3.0:1782529274.455105:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117251968 00000100:00100000:3.0:1782529274.455199:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782529274.455208:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117251968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529274.455247:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529274.455305:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117251968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529274.455312:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782529274.455365:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117251968:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782529274.455530:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529274.484246:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529274.484382:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108883200 00000100:00100000:3.0:1782529274.484393:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108883200 00000100:00100000:3.0:1782529274.484448:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 239 00000100:00100000:3.0:1782529274.484457:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+5:12099:x1869117108883200:12345-192.168.202.50@tcp:101:lsof.0 00010000:00010000:3.0:1782529274.484477:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529274.484497:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eacb0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae15d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529274.484567:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacb15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529274.484581:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacb15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529274.484592:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacb15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782529274.484793:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782529274.484798:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782529274.484935:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacb15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529274.484963:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045000/0x72bfdc08f7eacb0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae15d expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529274.484981:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacb15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae15d expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529274.484990:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:3.0:1782529274.484993:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782529274.484996:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:3.0:1782529274.485254:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+6:12099:x1869117108883200:12345-192.168.202.50@tcp:101:lsof.0 Request processed in 796us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529274.485263:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 239 00000001:00080000:2.0:1782529275.002052:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1782529275.002966:0:5816:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1782529275.003007:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1782529275.003018:0:5827:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1782529275.335019:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529276.361571:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529276.999219:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117252096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529276.999291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529277.000031:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117252096 00000100:00100000:2.0:1782529277.000042:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117252096 00000100:00100000:2.0:1782529277.000115:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782529277.000125:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117252096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529277.000163:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529277.000232:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117252096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529277.000239:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1782529277.000268:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782529277.000434:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117252480:0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.000468:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529277.000514:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529277.000521:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117252608:0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.000546:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529277.000546:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117252352:0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.000575:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117252480 00000100:00100000:1.0:1782529277.000579:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117252480 00000100:00100000:0.0:1782529277.000588:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529277.000614:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782529277.000621:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117252224:0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.000631:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117252608 00000100:00100000:1.0:1782529277.000634:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117252608 00000100:00100000:1.0:1782529277.000658:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117252352 00000100:00100000:1.0:1782529277.000661:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117252352 00000100:00100000:1.0:1782529277.000673:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782529277.000680:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117252480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.000723:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117252480:12345-0@lo:400:kworker.0 Request processed in 44us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529277.000729:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782529277.000742:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782529277.000747:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117252608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.000770:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117252608:12345-0@lo:400:kworker.0 Request processed in 24us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529277.000776:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782529277.000786:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782529277.000791:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c680cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117252352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.000828:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c680cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117252352:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529277.000868:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1782529277.000886:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529277.000913:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117252608:0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.000924:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117252480:0@lo:400:kworker.0 00000100:00100000:3.0:1782529277.001212:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117252096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782529277.001229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529277.001326:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117252736:0@lo:400:kworker.0 00000100:00100000:0.0:1782529277.001353:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529277.001389:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117252352:0@lo:400:kworker.0 00000100:00100000:3.0:1782529277.001766:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117252736 00000100:00100000:3.0:1782529277.001772:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117252736 00000100:00100000:3.0:1782529277.001863:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782529277.001871:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117252736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529277.001919:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117252736:12345-0@lo:400:kworker.0 Request processed in 50us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529277.001937:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782529277.001969:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117252736:0@lo:400:kworker.0 00000100:00080000:0.0:1782529277.002194:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529277.014017:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117252224 00000100:00100000:1.0:1782529277.014045:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117252224 00000100:00100000:1.0:1782529277.014135:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1782529277.014144:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117252224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529277.014251:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3297:x1869117117252224:12345-0@lo:400:kworker.0 Request processed in 108us (13024us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529277.014258:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1782529277.014387:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117252224:0@lo:400:kworker.0 00010000:00010000:3.0:1782529277.386246:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782529277.933327:0:12695:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:01:16 (1782529276) 00010000:00010000:2.0:1782529278.419442:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529278.801750:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529278.801821:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108883456 00000100:00100000:0.0:1782529278.801864:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108883456 00000100:00100000:0.0:1782529278.801931:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 170 00000100:00100000:0.0:1782529278.801941:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:2343:x1869117108883456:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529278.802032:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:2343:x1869117108883456:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 92us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529278.802041:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 170 00000100:00080000:2.0:1782529278.802510:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529278.806677:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529278.806711:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529278.806741:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529278.806770:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529278.806829:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108883712 00000100:00100000:2.0:1782529278.806988:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108883712 00000100:00100000:2.0:1782529278.807047:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108883584 00000100:00100000:2.0:1782529278.807050:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108883584 00000100:00100000:2.0:1782529278.807068:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:2.0:1782529278.807077:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108883712:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529278.807147:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2343:x1869117108883712:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 71us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529278.807154:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:2.0:1782529278.807178:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:2.0:1782529278.807184:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108883584:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529278.807205:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2344:x1869117108883584:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 21us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529278.807210:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:2.0:1782529278.807227:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108883840 00000100:00100000:2.0:1782529278.807231:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108883840 00000100:00100000:2.0:1782529278.807256:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00100000:2.0:1782529278.807261:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+6:2344:x1869117108883840:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529278.807285:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0893e068-92fc-4766-84ad-86afc0006669+6:2344:x1869117108883840:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529278.807303:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00100000:3.0:1782529278.807462:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108883328 00000100:00100000:3.0:1782529278.807466:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108883328 00000100:00100000:3.0:1782529278.807607:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 303 00000100:00100000:3.0:1782529278.807614:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108883328:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529278.807638:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2344:x1869117108883328:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529278.807644:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 303 00000100:00080000:0.0:1782529278.807715:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782529278.807719:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782529278.807721:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782529279.431880:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782529279.495259:0:11551:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782529279.495268:0:11551:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782529279.495877:0:11551:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1782529279.495885:0:11551:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782529279.560813:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529279.560856:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117252864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529279.560933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529279.565137:0:6594:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117252864 00000100:00100000:3.0:1782529279.565154:0:6594:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117252864 00000100:00100000:3.0:1782529279.565241:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782529279.565251:0:6594:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117252864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529279.565291:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529279.565376:0:6594:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117252864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529279.565383:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1782529279.567331:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782529279.567402:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117252864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782529280.459278:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529281.219939:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529281.220255:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108884096 00000100:00100000:2.0:1782529281.220265:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108884096 00000100:00100000:2.0:1782529281.220351:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:2.0:1782529281.220363:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+18:12320:x1869117108884096:12345-192.168.202.50@tcp:35:umount.0 00000100:00100000:2.0:1782529281.220951:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:12320:x1869117108884096:12345-192.168.202.50@tcp:35:umount.0 Request processed in 588us (1020us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1782529281.220960:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00080000:0.0:1782529281.221062:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529281.226396:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529281.226612:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108884352 00000100:00100000:3.0:1782529281.226623:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108884352 00000100:00100000:3.0:1782529281.226687:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:3.0:1782529281.226697:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+19:12320:x1869117108884352:12345-192.168.202.50@tcp:35:umount.0 00000100:00100000:3.0:1782529281.227220:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:12320:x1869117108884352:12345-192.168.202.50@tcp:35:umount.0 Request processed in 522us (834us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1782529281.227243:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:3.0:1782529281.229996:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529281.230119:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108884608 00000100:00100000:1.0:1782529281.230130:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108884608 00000100:00100000:1.0:1782529281.230223:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:1.0:1782529281.230234:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c665759c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+20:12320:x1869117108884608:12345-192.168.202.50@tcp:35:umount.0 00000100:00100000:1.0:1782529281.231134:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c665759c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:12320:x1869117108884608:12345-192.168.202.50@tcp:35:umount.0 Request processed in 899us (1144us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1782529281.231144:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:0.0:1782529281.235901:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529281.236256:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108884864 00000100:00100000:3.0:1782529281.236265:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108884864 00000100:00100000:3.0:1782529281.236347:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:3.0:1782529281.236355:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+21:12320:x1869117108884864:12345-192.168.202.50@tcp:35:umount.0 00000100:00100000:3.0:1782529281.236803:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:12320:x1869117108884864:12345-192.168.202.50@tcp:35:umount.0 Request processed in 448us (975us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1782529281.236812:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:2.0:1782529281.244220:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529281.244263:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529281.244415:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108884992 00000100:00100000:0.0:1782529281.244459:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108884992 00000100:00100000:0.0:1782529281.244533:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108885120 00000100:00100000:0.0:1782529281.244537:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108885120 00000100:00100000:0.0:1782529281.244569:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:0.0:1782529281.244579:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+14:2343:x1869117108884992:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529281.244596:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529281.244629:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972a400/0x72bfdc08f7eabb8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adce8 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529281.244649:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529281.244718:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+13:2343:x1869117108884992:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 139us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529281.244726:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:0.0:1782529281.244744:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1782529281.244751:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+12:2343:x1869117108885120:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529281.244759:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529281.244770:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972b400/0x72bfdc08f7eabaf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcb0 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529281.244781:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529281.244797:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:2343:x1869117108885120:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 48us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529281.244803:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1782529281.252651:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529281.252734:0:5778:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108885248 00000100:00100000:1.0:1782529281.252744:0:5778:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108885248 00000100:00100000:1.0:1782529281.252811:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:1.0:1782529281.252821:0:5778:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:2344:x1869117108885248:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529281.252871:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529281.252892:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682045c00/0x72bfdc08f7eabd77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addb3 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529281.252909:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529281.252966:0:5778:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2344:x1869117108885248:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 146us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529281.252974:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1782529281.261233:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529281.261496:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108885376 00000100:00100000:2.0:1782529281.261507:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108885376 00000100:00100000:2.0:1782529281.261635:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:2.0:1782529281.261647:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2340:x1869117108885376:12345-192.168.202.50@tcp:9:umount.0 00000020:00000080:2.0:1782529281.261682:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabe65 00000100:00080000:2.0:1782529281.261693:0:6593:0:(import.c:65:import_set_state_nolock()) ffff99c680351000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782529281.261742:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1782529281.262084:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+2:2340:x1869117108885376:12345-192.168.202.50@tcp:9:umount.0 Request processed in 439us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529281.262104:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00010000:00010000:3.0:1782529281.262569:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782529281.268373:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529281.272586:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529281.272917:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108885760 00000100:00100000:2.0:1782529281.272929:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108885760 00000100:00100000:2.0:1782529281.273128:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:2.0:1782529281.273139:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2340:x1869117108885760:12345-192.168.202.50@tcp:9:umount.0 00000020:00000080:2.0:1782529281.273175:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eac0cd 00000020:00010000:2.0:1782529281.273183:0:6592:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99c6500a1800: total 0 00000100:00080000:2.0:1782529281.273187:0:6592:0:(import.c:65:import_set_state_nolock()) ffff99c649ef2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782529281.273277:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1782529281.273587:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+5:2340:x1869117108885760:12345-192.168.202.50@tcp:9:umount.0 Request processed in 449us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529281.273595:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00080000:0.0:1782529281.273916:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1782529281.276798:0:5782:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99c6500a1800: total 0 00010000:00010000:1.0:1782529281.276881:0:5782:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99c6500a1800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782529281.276952:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b9a85fe/0x72bfdc08f7eac469 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf88 expref: 4 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529281.276995:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e30d696/0x72bfdc08f7eacb07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae156 expref: 3 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529281.277040:0:5782:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99c6500a1800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1782529281.277052:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529281.277054:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529281.277056:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529281.285624:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529281.285765:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108886784 00000100:00100000:0.0:1782529281.285789:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108886784 00000100:00100000:0.0:1782529281.285882:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 240 00000100:00100000:0.0:1782529281.285892:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+22:2340:x1869117108886784:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:0.0:1782529281.285930:0:6616:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabb01 00000020:00010000:0.0:1782529281.285946:0:6616:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99c6787ad000: total 0 00000100:00080000:0.0:1782529281.285951:0:6616:0:(import.c:65:import_set_state_nolock()) ffff99c6587e3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782529281.285981:0:6616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1782529281.286850:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99c6787ad000: total 0 00010000:00010000:3.0:1782529281.286856:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529281.286909:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99c6787ad000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1782529281.286941:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:3.0:1782529281.286945:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782529281.286953:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7eabe3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adddd expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.286971:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:3.0:1782529281.286974:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782529281.286978:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00a00/0x72bfdc08f7eac9e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae109 expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.286988:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99c669568200) 00010000:00010000:3.0:1782529281.286990:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782529281.287003:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6200/0x72bfdc08f7eac128 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adeaf expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287022:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:3.0:1782529281.287025:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782529281.287029:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7eac4e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfab expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287041:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99c669568700) 00010000:00010000:3.0:1782529281.287043:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782529281.287047:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6800/0x72bfdc08f7eac7c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae07d expref: 17 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287062:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:3.0:1782529281.287064:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782529281.287080:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c640030000/0x72bfdc08f7eac34a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf3b expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287095:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:3.0:1782529281.287098:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782529281.287102:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c65972be00/0x72bfdc08f7eac4cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adfa4 expref: 15 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287113:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:3.0:1782529281.287116:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529281.287120:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170600/0x72bfdc08f7eabde7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addc8 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287143:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:3.0:1782529281.287151:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529281.287156:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c6600/0x72bfdc08f7eac42a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf73 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287169:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:3.0:1782529281.287171:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782529281.287174:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00c00/0x72bfdc08f7eacac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae141 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287185:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99c643b34b00) 00010000:00010000:3.0:1782529281.287187:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782529281.287190:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682170000/0x72bfdc08f7eacaf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae14f expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287205:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99c643b34c00) 00010000:00010000:3.0:1782529281.287207:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782529281.287211:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c6587c7200/0x72bfdc08f7eabdcb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addc1 expref: 10 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287224:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99c642b0f700) 00010000:00010000:3.0:1782529281.287227:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782529281.287230:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7eac454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adf81 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529281.287252:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99c6787ad000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1782529281.287266:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529281.287267:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529281.287269:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529281.290732:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:089f7aa7-7be0-48a9-8829-cfc80cd2ee18+7:2340:x1869117108886784:12345-192.168.202.50@tcp:39:umount.0 Request processed in 4825us (5115us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1782529281.290749:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 240 00010000:00010000:1.0:1782529281.479026:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529282.119224:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117253248:0@lo:400:kworker.0 00000100:00100000:0.0:1782529282.119293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529282.119355:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782529282.119361:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117253376:0@lo:400:kworker.0 00000100:00100000:0.0:1782529282.119388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529282.119423:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117253248 00000100:00100000:0.0:1782529282.119430:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117253248 00000100:00100000:0.0:1782529282.119492:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1782529282.119502:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117253248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529282.119551:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117253248:12345-0@lo:400:kworker.0 Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529282.119559:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1782529282.119583:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529282.119615:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117253248:0@lo:400:kworker.0 00000100:00100000:0.0:1782529282.119640:0:6593:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117253376 00000100:00100000:0.0:1782529282.119643:0:6593:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117253376 00000100:00100000:0.0:1782529282.119673:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782529282.119693:0:6593:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117253376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529282.119728:0:6593:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117253376:12345-0@lo:400:kworker.0 Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529282.119734:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1782529282.119752:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529282.119767:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117253376:0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.119911:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117253120:0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.119947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529282.119977:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117253632:0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.119997:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529282.120016:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782529282.120022:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117252992:0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120047:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529282.120084:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117253504:0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120106:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529282.120131:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117252992 00000100:00100000:3.0:1782529282.120135:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117252992 00000100:00100000:3.0:1782529282.120162:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1782529282.120168:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117252992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120201:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3295:x1869117117252992:12345-0@lo:400:kworker.0 Request processed in 33us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529282.120207:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1782529282.120233:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117253120 00000100:00100000:3.0:1782529282.120237:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117253120 00000100:00100000:3.0:1782529282.120252:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117253504 00000100:00100000:3.0:1782529282.120254:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117253504 00000100:00100000:3.0:1782529282.120272:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782529282.120277:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117253120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120301:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117253120:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529282.120305:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782529282.120314:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782529282.120319:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117253504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120351:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117253504:12345-0@lo:400:kworker.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529282.120356:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1782529282.120367:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529282.120383:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117252992:0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120393:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117253504:0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120401:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117253120:0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120423:0:6592:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117253632 00000100:00100000:3.0:1782529282.120426:0:6592:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117253632 00000100:00100000:3.0:1782529282.120465:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782529282.120472:0:6592:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117253632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529282.120505:0:6592:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117253632:12345-0@lo:400:kworker.0 Request processed in 34us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529282.120511:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1782529282.120527:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529282.120542:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117253632:0@lo:400:kworker.0 00000100:00100000:1.0:1782529282.120811:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117253760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529282.120860:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529282.120928:0:10761:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117253760 00000100:00100000:2.0:1782529282.120933:0:10761:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117253760 00000100:00100000:2.0:1782529282.120964:0:10761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782529282.120970:0:10761:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67869dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117253760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529282.120998:0:10761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529282.121039:0:10761:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67869dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117253760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529282.121045:0:10761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782529282.121173:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117253760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782529282.509238:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529282.918070:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529282.918116:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529282.921534:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108886912 00000100:00100000:1.0:1782529282.921550:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108886912 00000100:00100000:1.0:1782529282.921686:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108887040 00000100:00100000:1.0:1782529282.921690:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108887040 00000100:00100000:1.0:1782529282.921735:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1782529282.921745:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+11:2344:x1869117108886912:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529282.921773:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529282.921792:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030600/0x72bfdc08f7eabbd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcfd expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529282.921811:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529282.921898:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+10:2344:x1869117108886912:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 154us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529282.921906:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1782529282.921938:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:1.0:1782529282.921945:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650285450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+9:2341:x1869117108887040:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529282.921954:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529282.921976:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eabbda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0add27 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529282.921986:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529282.922004:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650285450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:2341:x1869117108887040:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 60us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529282.922010:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1782529282.924932:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529282.925224:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108887168 00000100:00100000:1.0:1782529282.925236:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108887168 00000100:00100000:1.0:1782529282.925296:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:1.0:1782529282.925306:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+8:2341:x1869117108887168:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782529282.925321:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529282.925341:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682171a00/0x72bfdc08f7eabd70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0addac expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529282.925362:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529282.925428:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+7:2341:x1869117108887168:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 123us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529282.925436:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:1.0:1782529282.932596:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529282.932712:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108887424 00000100:00100000:3.0:1782529282.932721:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108887424 00000100:00100000:3.0:1782529282.932781:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 241 00000100:00100000:3.0:1782529282.932792:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c5410f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+6:2340:x1869117108887424:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:3.0:1782529282.932830:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabbe8 00000020:00010000:3.0:1782529282.932856:0:5794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99c680354000: total 0 00000100:00080000:3.0:1782529282.932874:0:5794:0:(import.c:65:import_set_state_nolock()) ffff99c680356000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1782529282.932895:0:5782:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99c680354000: total 0 00000001:00000004:3.0:1782529282.932898:0:5794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00010000:00010000:1.0:1782529282.932947:0:5782:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99c680354000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782529282.932977:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c6601f9e00) 00010000:00010000:1.0:1782529282.932980:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782529282.932988:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044a00/0x72bfdc08f7eacb15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae15d expref: 5 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529282.933008:0:5782:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99c680354000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782529282.933024:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529282.933026:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529282.933028:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529282.933131:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c5410f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0893e068-92fc-4766-84ad-86afc0006669+3:2340:x1869117108887424:12345-192.168.202.50@tcp:39:umount.0 Request processed in 340us (544us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1782529282.933139:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 241 00000100:00080000:0.0:1782529282.933221:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529282.963716:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529282.963778:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108887680 00000100:00100000:1.0:1782529282.963788:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108887680 00000100:00100000:1.0:1782529282.963886:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 305 00000100:00100000:1.0:1782529282.963897:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+7:2340:x1869117108887680:12345-192.168.202.50@tcp:251:umount.0 00000020:00000080:2.0:1782529282.964139:0:5787:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabade 00000020:00010000:2.0:1782529282.964147:0:5787:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99c677945000: total 0 00000100:00080000:2.0:1782529282.964151:0:5787:0:(import.c:65:import_set_state_nolock()) ffff99c677940000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1782529282.964191:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99c677945000: total 0 00010000:00010000:0.0:1782529282.964196:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529282.964223:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fc22fc8-b7b5-4103-b13b-bcf6224dd145+3:2340:x1869117108887680:12345-192.168.202.50@tcp:251:umount.0 Request processed in 328us (519us total) trans 0 rc 0/0 00010000:00010000:0.0:1782529282.964237:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99c677945000, canceled 0 locks, left on hash table 1. 00000100:00100000:2.0:1782529282.964245:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 305 00010000:00010000:0.0:1782529282.964280:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972a200/0x72bfdc08f7eabb94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0adcef expref: 2 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529282.964295:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99c677945000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782529282.964305:0:5781:0:(genops.c:906:class_export_put()) final put ffff99c677945000/7fc22fc8-b7b5-4103-b13b-bcf6224dd145 00010000:00010000:0.0:1782529282.964316:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529282.964318:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529282.964320:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782529282.964327:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c677945000/7fc22fc8-b7b5-4103-b13b-bcf6224dd145 for MGS 00000020:00000080:0.0:1782529282.964367:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c677940000 for MGS 00010000:00010000:1.0:1782529283.527109:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529284.552439:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529284.687218:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782529284.687241:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117253888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529284.687313:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529284.687376:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117253888 00000100:00100000:0.0:1782529284.687385:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117253888 00000100:00100000:0.0:1782529284.687449:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782529284.687458:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117253888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782529284.687494:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529284.689193:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117253888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1730us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529284.689205:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1782529284.689239:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529284.689284:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117253888:0@lo:13:osp-pre-1-0.0 00000020:01000004:1.0:1782529284.740549:0:12894:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782529284.762453:0:12894:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1782529284.762502:0:12894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.762517:0:12894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.762525:0:12894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.762532:0:12894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.762618:0:12894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782529284.762625:0:12894:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782529284.762647:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782529284.762651:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782529284.762656:0:12894:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782529284.762683:0:12894:0:(import.c:65:import_set_state_nolock()) ffff99c645000800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782529284.762748:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117254016:0@lo:39:umount.0 00000100:00100000:0.0:1782529284.762814:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529284.762989:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117254016 00000100:00100000:3.0:1782529284.762996:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117254016 00000100:00100000:3.0:1782529284.763055:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1782529284.763063:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869117117254016:12345-0@lo:39:umount.0 00000020:00000080:3.0:1782529284.763094:0:5795:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab8fb 00000100:00080000:3.0:1782529284.763102:0:5795:0:(import.c:65:import_set_state_nolock()) ffff99c6787ac000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1782529284.763593:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529284.763602:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.763611:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972a600 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529284.763615:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.763625:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529284.763632:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529284.763638:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782529284.763641:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1782529284.763643:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1782529284.763669:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.763675:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782529284.763719:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117254144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529284.763777:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782529284.763851:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.763859:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972a600/0x72bfdc08f7eabb63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.763870:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529284.763872:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529284.763880:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529284.763930:0:8316:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117254144 00000100:00100000:0.0:1782529284.763935:0:8316:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117254144 00000100:00100000:0.0:1782529284.763987:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782529284.763994:0:8316:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117254144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782529284.764004:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529284.764017:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a577800/0x72bfdc08f7eabb6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabb63 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529284.764038:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529284.764294:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3293:x1869117117254016:12345-0@lo:39:umount.0 Request processed in 1231us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529284.764303:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1782529284.764313:0:5795:0:(genops.c:906:class_export_put()) final put ffff99c6787af000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1782529284.764360:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c645000800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782529284.764373:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117254016:0@lo:39:umount.0 00010000:00010000:2.0:1782529284.764439:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529284.764514:0:8316:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adf301ee-99ae-4756-993e-d61f1989f0b8+18:3294:x1869117117254144:12345-0@lo:103:ldlm_bl.0 Request processed in 520us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529284.764521:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:0.0:1782529284.764542:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6787af000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1782529284.764661:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117254144:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1782529284.764682:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782529284.764685:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782529284.764689:0:12894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782529284.765563:0:12894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765576:0:12894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765583:0:12894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765589:0:12894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765608:0:12894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529284.765614:0:12894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765621:0:12894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765627:0:12894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765633:0:12894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765662:0:12894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782529284.765668:0:12894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765674:0:12894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765680:0:12894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765686:0:12894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765692:0:12894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782529284.765697:0:12894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765704:0:12894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765711:0:12894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765717:0:12894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529284.765724:0:12894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1782529284.765727:0:12894:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1782529284.765755:0:12894:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1782529284.765759:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1782529284.765764:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782529284.765769:0:12894:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/10 00000020:00080000:1.0:1782529284.765774:0:12894:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99c6587e0000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782529284.765780:0:12894:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99c67f60c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782529284.765786:0:12894:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff99c680354000 0893e068-92fc-4766-84ad-86afc0006669 192.168.202.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782529284.765791:0:12894:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff99c6787ad000 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 192.168.202.50@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1782529284.765796:0:12894:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff99c680cf0000) has exports, disconnecting them 00000020:00080000:1.0:1782529284.765800:0:12894:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99c6587e0000), last request at 1782529282 00000020:00000080:1.0:1782529284.765806:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eaba60 00000100:00080000:1.0:1782529284.765823:0:12894:0:(import.c:65:import_set_state_nolock()) ffff99c6587e1000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782529284.765884:0:12894:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99c6587e0000): rc 0 00000020:00000080:1.0:1782529284.765887:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c6587e0000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1782529284.765944:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782529284.765950:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.765957:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529284.765960:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.765969:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529284.765976:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529284.765982:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782529284.765984:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1782529284.765986:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1782529284.766012:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766018:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529284.766040:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766047:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eabb71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb78 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766058:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782529284.766061:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766073:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529284.766076:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766083:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529284.766089:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529284.766094:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1782529284.766096:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1782529284.766098:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1782529284.766111:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766117:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529284.766134:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766141:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c640031000/0x72bfdc08f7eaba98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eaba9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766153:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782529284.766156:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766162:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682171000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529284.766165:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766178:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529284.766184:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529284.766189:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1782529284.766191:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1782529284.766193:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1782529284.766207:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766213:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529284.766220:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766226:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682171000/0x72bfdc08f7eabd9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabda1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766236:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529284.766240:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766245:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044400 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529284.766248:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766254:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529284.766270:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529284.766275:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1782529284.766277:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1782529284.766279:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1782529284.766293:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766298:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529284.766304:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766309:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c682044400/0x72bfdc08f7eab84c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eab853 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766321:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529284.766322:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529284.766324:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529284.766342:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529284.766355:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117254656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529284.766403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529284.766451:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782529284.766457:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117254272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529284.766477:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529284.766503:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117254656 00000100:00100000:2.0:1782529284.766508:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117254656 00000100:00100000:2.0:1782529284.766539:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117254272 00000100:00100000:2.0:1782529284.766542:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117254272 00000100:00100000:2.0:1782529284.766573:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782529284.766581:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+19:3294:x1869117117254656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782529284.766593:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529284.766606:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972b600/0x72bfdc08f7eab853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eab84c expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766620:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529284.766651:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+18:3294:x1869117117254656:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529284.766659:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782529284.766684:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782529284.766690:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+17:3294:x1869117117254272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782529284.766697:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529284.766706:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a576600/0x72bfdc08f7eabb78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabb71 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529284.766716:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529284.766736:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3294:x1869117117254272:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529284.766742:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782529284.766776:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117254272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529284.766785:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117254656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782529284.767175:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117254528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782529284.767207:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529284.767236:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529284.767242:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117254400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782529284.767262:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529284.767287:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117254528 00000100:00100000:3.0:1782529284.767291:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117254528 00000100:00100000:3.0:1782529284.767311:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117254400 00000100:00100000:3.0:1782529284.767320:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117254400 00000100:00100000:3.0:1782529284.767338:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782529284.767344:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+17:3297:x1869117117254528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782529284.767351:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529284.767360:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d01e00/0x72bfdc08f7eabda1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabd9a expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529284.767369:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529284.767395:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+16:3297:x1869117117254528:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529284.767401:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782529284.767416:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782529284.767432:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+15:3297:x1869117117254400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782529284.767443:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529284.767451:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682044e00/0x72bfdc08f7eaba9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eaba98 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529284.767461:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529284.767482:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adf301ee-99ae-4756-993e-d61f1989f0b8+14:3297:x1869117117254400:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529284.767488:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782529284.767512:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117254400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782529284.767519:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:adf301ee-99ae-4756-993e-d61f1989f0b8:3297:1869117117254528:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1782529284.767636:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c6787ac000 for lustre-MDT0000 00000020:00080000:1.0:1782529284.768130:0:12894:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99c67f60c000), last request at 1782529282 00000020:00000080:1.0:1782529284.768153:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab995 00000100:00080000:1.0:1782529284.768180:0:12894:0:(import.c:65:import_set_state_nolock()) ffff99c67f609800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1782529284.768843:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6587e0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1782529284.768886:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c6587e1000 for lustre-MDT0000 00010000:00010000:2.0:1782529284.769234:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782529284.769349:0:12894:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99c67f60c000): rc 0 00000020:00000080:1.0:1782529284.769353:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c67f60c000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1782529284.769434:0:12894:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1b90160fae0 00000100:00080000:1.0:1782529284.769457:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782529284.769460:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1782529284.769478:0:12894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1782529284.769530:0:12894:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1782529284.769550:0:12894:0:(import.c:65:import_set_state_nolock()) ffff99c6587e1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1782529284.769576:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782529284.769579:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1782529284.769586:0:12894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1782529284.769655:0:12894:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1782529284.769666:0:12894:0:(import.c:65:import_set_state_nolock()) ffff99c6783bc800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1782529284.769696:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99c680cf0000) has no exports 00000100:00100000:0.0:1782529284.769762:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117254784:0@lo:9:umount.0 00000100:00100000:0.0:1782529284.769823:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529284.769886:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117254912:0@lo:9:umount.0 00000100:00100000:0.0:1782529284.769919:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529284.769955:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117254784 00000100:00100000:0.0:1782529284.769962:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117254784 00000100:00100000:0.0:1782529284.770015:0:6591:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117254912 00000100:00100000:0.0:1782529284.770019:0:6591:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117254912 00000100:00100000:0.0:1782529284.770172:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782529284.770182:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869117117254784:12345-0@lo:9:umount.0 00000020:00000080:0.0:1782529284.770208:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab9e2 00000100:00080000:0.0:1782529284.770214:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c67f620000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782529284.770247:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1782529284.770418:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3293:x1869117117254784:12345-0@lo:9:umount.0 Request processed in 238us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529284.770439:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782529284.770455:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782529284.770462:0:6591:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869117117254912:12345-0@lo:9:umount.0 00000020:00000080:0.0:1782529284.770474:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabac9 00000100:00080000:0.0:1782529284.770479:0:6591:0:(import.c:65:import_set_state_nolock()) ffff99c677947000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782529284.770502:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1782529284.770594:0:6591:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3293:x1869117117254912:12345-0@lo:9:umount.0 Request processed in 133us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529284.770600:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1782529284.770617:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782529284.770640:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782529284.770664:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6587e1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782529284.770669:0:3293:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782529284.770670:0:3293:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782529284.770674:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117254784:0@lo:9:umount.0 00000100:00080000:0.0:1782529284.770683:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6783bc800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782529284.770697:0:3293:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782529284.770698:0:3293:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782529284.770701:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117254912:0@lo:9:umount.0 00010000:00010000:0.0:1782529284.770726:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782529284.771531:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f60c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782529284.771686:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c67f609800 for lustre-MDT0000 00000020:00080000:1.0:1782529284.778267:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99c680cf0000) has no exports 00000020:00000080:1.0:1782529284.816938:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab8a7 00000020:00000080:1.0:1782529284.816953:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c6795c1800/lustre-QMT0000_UUID 00000020:01000000:1.0:1782529284.816978:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1782529284.817130:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529284.817140:0:12894:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782529284.817145:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff99c645a419c0) has no exports 00000020:00000080:2.0:1782529284.817486:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab8a0 00000020:00000080:2.0:1782529284.817507:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c6795c7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782529284.817558:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529284.817567:0:12894:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782529284.817627:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6795c1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1782529284.817633:0:37:0:(genops.c:906:class_export_put()) final put ffff99c6795c5800/lustre-QMT0000_UUID 00000020:00000080:3.0:1782529284.817640:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6795c5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1782529284.817649:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1782529284.817772:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6795c7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:0.0:1782529285.253342:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000001:00080000:0.0:1782529285.253366:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1782529285.259738:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0893e068-92fc-4766-84ad-86afc0006669 00000001:00080000:0.0:1782529285.259774:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1782529285.259780:0:5816:0:(genops.c:906:class_export_put()) final put ffff99c680354000/0893e068-92fc-4766-84ad-86afc0006669 00000020:00000080:0.0:1782529285.259900:0:5816:0:(genops.c:906:class_export_put()) final put ffff99c6787ad000/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:3.0:1782529285.260172:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680354000/0893e068-92fc-4766-84ad-86afc0006669 for lustre-MDT0000 00000020:00000080:3.0:1782529285.260242:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c680356000 for lustre-MDT0000 00000020:00000080:1.0:1782529285.260482:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6787ad000/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 for lustre-MDT0000 00000020:00000080:1.0:1782529285.260608:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c6587e3000 for lustre-MDT0000 00010000:00010000:0.0:1782529285.574999:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782529285.738424:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782529285.738433:0:6618:0:(genops.c:906:class_export_put()) final put ffff99c67f626000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1782529285.738456:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:3.0:1782529285.738459:0:6618:0:(genops.c:906:class_export_put()) final put ffff99c6500a1800/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:3.0:1782529285.738488:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f626000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1782529285.738534:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6500a1800/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 for lustre-OST0000 00000020:00000080:3.0:1782529285.738556:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c67f620000 for lustre-OST0000 00000020:00000080:3.0:1782529285.738561:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c649ef2800 for lustre-OST0000 00000001:00100000:1.0:1782529285.755576:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782529285.755587:0:7509:0:(genops.c:906:class_export_put()) final put ffff99c677942800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1782529285.755609:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:1.0:1782529285.755611:0:7509:0:(genops.c:906:class_export_put()) final put ffff99c680351800/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 00000020:00000080:3.0:1782529285.755978:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c677942800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1782529285.756033:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680351800/089f7aa7-7be0-48a9-8829-cfc80cd2ee18 for lustre-OST0001 00000020:00000080:3.0:1782529285.756050:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c677947000 for lustre-OST0001 00000020:00000080:3.0:1782529285.756055:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c680351000 for lustre-OST0001 00010000:00010000:0.0:1782529286.600274:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1782529286.855143:0:12894:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99c67f997180 - data ffff99c67fd34510/ffff99c67f1e2400 00000020:01000000:0.0:1782529286.855305:0:12894:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99c6485489c0 - data ffff99c6710311b0/ffff99c6795bbc00 00000001:00000004:0.0:1782529286.868219:0:12894:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1782529286.952563:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782529286.952573:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1782529286.952601:0:12894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782529286.952604:0:12894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782529286.953572:0:6767:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782529286.953579:0:6767:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1782529286.953589:0:6767:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1782529286.955628:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782529286.955636:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1782529286.955713:0:12894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782529286.955716:0:12894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782529286.960518:0:7956:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782529286.960526:0:7956:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1782529286.960538:0:7956:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1782529287.016335:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab86f 00000020:00000080:2.0:1782529287.016349:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c680028800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782529287.017521:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab884 00000020:00000080:2.0:1782529287.017530:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c680cf8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782529287.017539:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1782529287.017544:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529287.017551:0:12894:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782529287.017555:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99c6457b0000) has no exports 00000004:01000000:2.0:1782529287.017695:0:12894:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1782529287.017704:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eabac2 00000020:00000080:2.0:1782529287.017709:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c67f341000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782529287.017712:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782529287.017716:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529287.017722:0:12894:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782529287.017724:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff99c680cf3380) has no exports 00000020:00000080:2.0:1782529287.017730:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eababb 00000020:00000080:2.0:1782529287.017733:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c6783bb000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1782529287.018063:0:12894:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782529287.018068:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782529287.018073:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1782529287.018078:0:12894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782529287.018089:0:12894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782529287.018115:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529287.018121:0:12894:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782529287.018126:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab9db 00000020:00000080:2.0:1782529287.018129:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c67f608800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782529287.018132:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782529287.018135:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529287.018138:0:12894:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782529287.018140:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99c645aa4d40) has no exports 00000020:00000080:2.0:1782529287.018144:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab9d4 00000020:00000080:2.0:1782529287.018146:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c6587e4000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1782529287.018454:0:12894:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782529287.018457:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782529287.018459:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1782529287.018462:0:12894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782529287.018463:0:12894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782529287.018485:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529287.018489:0:12894:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782529287.018512:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529287.018514:0:12894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782529287.018537:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab88b 00000020:00000080:2.0:1782529287.018541:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c680cfd000/lustre-MDD0000_UUID 00000020:01000000:2.0:1782529287.018545:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1782529287.018548:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529287.018551:0:12894:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782529287.018553:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff99c680cf4d40) has no exports 00000020:00000080:2.0:1782529287.018569:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529287.018572:0:12894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1782529287.018574:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab892 00000020:00000080:2.0:1782529287.018578:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c680cff800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782529287.018587:0:12894:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c646a6f800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1782529287.018590:0:12894:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c646a6f800 3 00000020:01000004:2.0:1782529287.018593:0:12894:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99c646a6f800 from lustre-MDT0000 00000020:00000080:2.0:1782529287.018616:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529287.018619:0:12894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1782529287.018622:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c65f5b6800/lustre-MDT0000_UUID 00000020:00000080:2.0:1782529287.018625:0:12894:0:(genops.c:865:class_export_destroy()) destroying export ffff99c65f5b6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1782529287.018632:0:12894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1782529287.018686:0:12894:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1782529287.018689:0:12894:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1782529287.018692:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1782529287.018694:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529287.018697:0:12894:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782529287.018702:0:12894:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99c646104000 adf301ee-99ae-4756-993e-d61f1989f0b8 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782529287.018707:0:12894:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff99c645aa3380) has exports, disconnecting them 00000020:00080000:2.0:1782529287.018710:0:12894:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99c646104000), last request at 1782529056 00000020:00000080:2.0:1782529287.018723:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab829 00000020:00010000:2.0:1782529287.018727:0:12894:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99c646104000: total 8 00000100:00080000:2.0:1782529287.018731:0:12894:0:(import.c:65:import_set_state_nolock()) ffff99c645001000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782529287.018747:0:12894:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99c646104000): rc 0 00000020:00080000:2.0:1782529287.018751:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff99c645aa3380) has no exports 00000100:00100000:2.0:1782529287.018876:0:5787:0:(service.c:3182:ptlrpc_main()) ll_mgs_0000: service thread [ffff99c64608cc00:5787] 0 exiting: rc = 1 00000020:00000080:1.0:1782529287.019383:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680028800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782529287.019401:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680cf8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1782529287.019417:0:38:0:(genops.c:906:class_export_put()) final put ffff99c68002f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782529287.019419:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c68002f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1782529287.019423:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782529287.019549:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f341000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1782529287.019566:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6783bb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782529287.019571:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c6783bc800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1782529287.019576:0:38:0:(genops.c:906:class_export_put()) final put ffff99c6783b9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782529287.019578:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6783b9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1782529287.019582:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782529287.019610:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f608800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1782529287.019621:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6587e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782529287.019625:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c6587e1800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1782529287.019629:0:38:0:(genops.c:906:class_export_put()) final put ffff99c67f608000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782529287.019631:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f608000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1782529287.019634:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782529287.019695:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680cfd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1782529287.019699:0:38:0:(genops.c:906:class_export_put()) final put ffff99c65f5b3000/lustre-MDD0000_UUID 00000020:00000080:1.0:1782529287.019701:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c65f5b3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1782529287.019704:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1782529287.019871:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680cff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1782529287.020003:0:5782:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99c646104000: total 0 00010000:00010000:0.0:1782529287.020043:0:5782:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99c646104000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1782529287.020080:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a577200/0x72bfdc08f7eabb4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabb47 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529287.020096:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a577e00/0x72bfdc08f7eabb5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabb55 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529287.020108:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d01200/0x72bfdc08f7eabd85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabd7e expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529287.020117:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682045200/0x72bfdc08f7eabd93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabd8c expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529287.020140:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640031600/0x72bfdc08f7eab948 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eab941 expref: 5 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529287.020152:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eabb86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabb7f expref: 4 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529287.020161:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c64a576000/0x72bfdc08f7eabb40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabb39 expref: 3 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529287.020172:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c65972a000/0x72bfdc08f7eabb32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bfdc08f7eabb2b expref: 2 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529287.020182:0:5782:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99c646104000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1782529287.020193:0:5782:0:(genops.c:906:class_export_put()) final put ffff99c646104000/adf301ee-99ae-4756-993e-d61f1989f0b8 00010000:00010000:0.0:1782529287.020210:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529287.020212:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529287.020214:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782529287.020465:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c646104000/adf301ee-99ae-4756-993e-d61f1989f0b8 for MGS 00000100:00100000:3.0:1782529287.020625:0:5788:0:(service.c:3182:ptlrpc_main()) ll_mgs_0001: service thread [ffff99c64608c600:5788] 1 exiting: rc = 0 00000100:00100000:3.0:1782529287.020695:0:5789:0:(service.c:3182:ptlrpc_main()) ll_mgs_0002: service thread [ffff99c64608c800:5789] 2 exiting: rc = 0 00000100:00100000:1.0:1782529287.021039:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021048:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021054:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021069:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021074:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021081:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021089:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021095:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021101:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021106:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021112:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021117:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021123:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021128:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021133:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021139:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021145:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021150:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021156:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021162:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021168:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021174:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021188:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021195:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021200:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021205:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021209:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021214:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021220:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021226:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021231:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021236:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021241:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021247:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021252:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021258:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021263:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021269:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021273:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021292:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021298:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021303:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021308:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021314:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021320:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021324:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021329:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021334:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021339:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021345:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021350:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021356:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021361:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021367:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021372:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021377:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021383:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021397:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021418:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021425:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021431:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021436:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021441:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.021446:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1782529287.021808:0:12894:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782529287.021812:0:12894:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1782529287.022509:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c645001000 for MGS 00000020:01000000:1.0:1782529287.023457:0:12894:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99c647ea8720 - data ffff99c67102f948/ffff99c6780ae000 00000020:01000000:1.0:1782529287.023574:0:12894:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99c648015ae0 - data ffff99c66b98b288/ffff99c6457aec00 00000020:00000080:1.0:1782529287.024507:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab814 00000020:00000080:1.0:1782529287.024515:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c646104800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1782529287.024536:0:12894:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c646a6f800 from MGS, refs=2 00000020:01000004:1.0:1782529287.024540:0:12894:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c646a6f800 2 00000020:01000004:1.0:1782529287.024542:0:12894:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99c646a6f800 from MGS 00000020:00000080:1.0:1782529287.024575:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782529287.024582:0:12894:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1782529287.024584:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c646105800/MGS 00000020:00000080:1.0:1782529287.024587:0:12894:0:(genops.c:865:class_export_destroy()) destroying export ffff99c646105800/MGS for MGS 00000020:01000000:1.0:1782529287.024594:0:12894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1782529287.024646:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1782529287.024649:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782529287.024653:0:12894:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782529287.024659:0:12894:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99c645a68000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782529287.024665:0:12894:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff99c645aa0000) has exports, disconnecting them 00000020:00080000:1.0:1782529287.024668:0:12894:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99c645a68000), last request at 1782529057 00000020:00000080:1.0:1782529287.024672:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab8df 00000020:00080000:1.0:1782529287.024684:0:12894:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99c645a68000): rc 0 00000020:00000080:1.0:1782529287.024688:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c645a68000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782529287.025699:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c646104800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782529287.025711:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c645a68000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1782529287.032138:0:12894:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1782529287.032148:0:12894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782529287.032153:0:12894:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782529287.032161:0:12894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782529287.032199:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c645000800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1782529287.032349:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782529287.032358:0:12894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1782529287.032363:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c65f592000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1782529287.032367:0:12894:0:(genops.c:865:class_export_destroy()) destroying export ffff99c65f592000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1782529287.032378:0:12894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1782529287.032450:0:12894:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c646a6f800 1 00000020:00000080:0.0:1782529287.032468:0:12894:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab806 00000020:00000080:0.0:1782529287.032474:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c646102800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1782529287.032484:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1782529287.032492:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c646102800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782529287.032501:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782529287.032505:0:12894:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782529287.032509:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99c645a44d40) has no exports 00000020:00000080:2.0:1782529287.082925:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529287.082939:0:12894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1782529287.082943:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c64531d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782529287.082948:0:12894:0:(genops.c:865:class_export_destroy()) destroying export ffff99c64531d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1782529287.082957:0:12894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1782529287.083180:0:12894:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff99c646a68000 00000020:01000000:2.0:1782529287.083201:0:12894:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1782529287.083211:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529287.083215:0:12894:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782529287.083218:0:12894:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99c6457b3380) has no exports 00000100:00100000:0.0:1782529287.086821:0:5796:0:(service.c:3182:ptlrpc_main()) mdt00_002: service thread [ffff99c6457f3c00:5796] 2 exiting: rc = 0 00000100:00100000:3.0:1782529287.087176:0:5794:0:(service.c:3182:ptlrpc_main()) mdt00_000: service thread [ffff99c6457f3800:5794] 0 exiting: rc = 1 00000100:00100000:3.0:1782529287.087235:0:5795:0:(service.c:3182:ptlrpc_main()) mdt00_001: service thread [ffff99c6457f2000:5795] 1 exiting: rc = 0 00000100:00100000:1.0:1782529287.087769:0:6616:0:(service.c:3182:ptlrpc_main()) mdt00_003: service thread [ffff99c67f5adc00:6616] 3 exiting: rc = 0 00000100:00100000:2.0:1782529287.088655:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088664:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088671:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088676:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088682:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088688:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088694:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088700:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088706:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088712:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088717:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088723:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088729:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088735:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088741:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088747:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088752:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088758:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088765:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088771:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088777:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088782:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088788:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088793:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088799:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088804:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088810:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088816:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088821:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088827:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088937:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088944:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088962:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088967:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088976:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088982:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088988:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.088994:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089000:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089006:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089072:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089081:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089087:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089092:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089098:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089104:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089110:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089115:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089121:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089126:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089132:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089138:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089144:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089149:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089155:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089161:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089166:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089172:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089177:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089183:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089189:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089194:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089201:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.089207:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782529287.097210:0:5797:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99c64608da00:5797] 0 exiting: rc = 1 00000100:00100000:0.0:1782529287.097950:0:5798:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99c66579f000:5798] 1 exiting: rc = 0 00000100:00100000:2.0:1782529287.098148:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098157:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098164:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098180:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098186:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098193:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098198:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098204:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098209:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098215:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098222:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098227:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098234:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098239:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098244:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098249:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098254:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098259:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098264:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098269:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098286:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098292:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098298:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098303:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098308:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098312:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098316:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098321:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098326:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098331:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098336:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098341:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098347:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098352:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098356:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098362:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098367:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098371:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098383:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098388:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098394:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098398:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098414:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098419:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098424:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098429:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098434:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098438:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098443:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098447:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098451:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098456:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098460:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098465:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098471:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098476:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098480:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098486:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098491:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098496:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098502:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098508:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098513:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098518:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.098956:0:5800:0:(service.c:3182:ptlrpc_main()) mdt_out00_001: service thread [ffff99c64987ae00:5800] 1 exiting: rc = 0 00000100:00100000:0.0:1782529287.099261:0:5799:0:(service.c:3182:ptlrpc_main()) mdt_out00_000: service thread [ffff99c64987a400:5799] 0 exiting: rc = 1 00000100:00100000:2.0:1782529287.099395:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099412:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099428:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099434:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099440:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099447:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099453:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099459:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099474:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099480:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099486:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099492:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099497:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099503:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099524:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099530:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099536:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099541:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099548:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099616:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099622:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099628:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099633:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099638:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099644:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099649:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099666:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099672:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099677:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099683:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099688:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099693:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099699:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099704:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099710:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099715:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099721:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099726:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099744:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099750:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099755:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099760:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099765:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099774:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099779:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099784:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099789:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099794:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099798:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099804:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099819:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099825:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099964:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099972:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099978:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099983:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099988:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099993:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.099998:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.100003:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.100008:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.100082:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.100091:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.100105:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782529287.116270:0:5801:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99c645b76200:5801] 0 exiting: rc = 1 00000100:00100000:2.0:1782529287.116970:0:5802:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99c646ae6a00:5802] 1 exiting: rc = 0 00000100:00100000:0.0:1782529287.117154:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117161:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117166:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117171:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117177:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117182:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117187:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117193:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117198:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117203:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117209:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117214:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117219:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117224:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117229:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117233:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117239:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117244:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117249:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117255:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117260:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117264:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117269:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117348:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117363:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117368:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117373:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117377:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117382:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117386:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117391:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117395:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117400:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117417:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117423:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117428:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117434:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117439:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117443:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117448:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117452:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117457:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117462:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117467:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117472:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117476:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117482:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117487:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117492:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117496:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117502:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117506:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117511:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117515:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117520:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117525:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117530:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117535:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117540:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117551:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117629:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117635:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117640:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117645:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.117991:0:5803:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99c645147600:5803] 0 exiting: rc = 1 00000100:00100000:2.0:1782529287.118185:0:5804:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99c645147e00:5804] 1 exiting: rc = 0 00000100:00100000:0.0:1782529287.118270:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118353:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118359:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118364:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118370:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118375:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118381:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118388:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118394:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118400:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118415:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118421:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118426:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118431:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118437:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118442:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118447:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118452:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118457:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118463:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118469:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118474:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118479:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118483:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118488:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118492:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118497:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118502:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118507:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118521:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118526:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118530:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118535:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118540:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118546:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118552:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118630:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118636:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118641:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118645:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118651:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118655:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118661:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118665:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118670:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118676:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118681:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118685:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118689:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118695:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118700:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118705:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118710:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118714:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118719:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118723:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118728:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118734:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118739:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118744:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118748:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118753:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118757:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.118763:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529287.119421:0:5806:0:(service.c:3182:ptlrpc_main()) mdt_fld_0001: service thread [ffff99c66579f600:5806] 1 exiting: rc = 0 00000100:00100000:3.0:1782529287.119701:0:5805:0:(service.c:3182:ptlrpc_main()) mdt_fld_0000: service thread [ffff99c66579f400:5805] 0 exiting: rc = 1 00000100:00100000:0.0:1782529287.122776:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122786:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122792:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122798:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122804:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122810:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122815:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122821:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122826:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122852:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122859:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122864:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122870:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122875:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122880:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122885:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122890:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122895:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122900:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122905:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122910:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122915:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122920:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122926:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122930:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122935:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122940:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122945:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122949:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122954:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122960:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122964:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122969:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122974:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122980:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.122997:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123003:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123008:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123025:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123031:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123036:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123041:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123046:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123051:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123056:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123061:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123068:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123073:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123078:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123083:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123088:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123093:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123098:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123102:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123107:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123112:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123117:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123123:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123128:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123133:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123138:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123143:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123149:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.123154:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124082:0:5807:0:(service.c:3182:ptlrpc_main()) mdt_io00_000: service thread [ffff99c64514c200:5807] 0 exiting: rc = 1 00000100:00100000:0.0:1782529287.124418:0:5809:0:(service.c:3182:ptlrpc_main()) mdt_io00_002: service thread [ffff99c64503b000:5809] 2 exiting: rc = 0 00000100:00100000:1.0:1782529287.124768:0:5808:0:(service.c:3182:ptlrpc_main()) mdt_io00_001: service thread [ffff99c64503ba00:5808] 1 exiting: rc = 0 00000100:00100000:0.0:1782529287.124925:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124932:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124937:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124944:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124959:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124964:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124971:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124976:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124982:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124987:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.124993:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125000:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125005:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125066:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125076:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125081:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125086:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125091:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125097:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125114:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125121:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125127:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125133:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125138:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125143:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125148:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125154:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125160:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125165:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125171:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125176:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125181:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125186:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125192:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125198:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125203:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125208:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125213:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125218:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125230:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125235:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125240:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125246:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125262:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125268:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125273:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125351:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125356:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125362:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125367:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125373:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125378:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125384:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125389:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125394:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125399:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125414:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125419:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125425:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125431:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125435:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125440:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125445:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529287.125453:0:12894:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1782529287.133495:0:12894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782529287.133509:0:12894:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1782529287.133515:0:12894:0:(genops.c:906:class_export_put()) final put ffff99c645003000/MDS_uuid 00000020:00000080:0.0:1782529287.133520:0:12894:0:(genops.c:865:class_export_destroy()) destroying export ffff99c645003000/MDS_uuid for MDS 00000020:01000000:0.0:1782529287.133525:0:12894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1782529287.133738:0:12894:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1782529287.245271:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117255040:0@lo:400:kworker.0 00000400:00000100:1.0:1782529287.245328:0:3295:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869117117255040 offset 0 length 224: 4 00000100:00100000:1.0:1782529287.245394:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117255168:0@lo:400:kworker.0 00000400:00000100:1.0:1782529287.245428:0:3296:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869117117255168 offset 0 length 224: 4 00000100:00100000:1.0:1782529287.245442:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529287.245448:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117255296:0@lo:400:kworker.0 00000400:00000100:1.0:1782529287.245465:0:3296:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869117117255296 offset 0 length 224: 4 00010000:00010000:0.0:1782529287.622935:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529288.647273:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529289.674010:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782529289.911286:0:13047:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782529289.924052:0:13047:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1782529289.924105:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529289.924119:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529289.924126:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529289.924133:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529289.924186:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782529289.924193:0:13047:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782529289.924215:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782529289.924226:0:13047:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff99c67831a300 x1869117117255168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529289.924254:0:13047:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782529289.924274:0:13047:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782529289.924299:0:13047:0:(import.c:65:import_set_state_nolock()) ffff99c67f623000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782529289.924339:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3293:1869117117255424:0@lo:39:umount.0 00000400:00000100:1.0:1782529289.924399:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869117117255424 offset 0 length 224: 4 00000100:00100000:2.0:1782529289.925547:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117255168:0@lo:400:kworker.0 00010000:00010000:0.0:1782529289.928058:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529289.928088:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529289.928100:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01600 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529289.928104:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529289.928115:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529289.928123:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529289.928129:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782529289.928131:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782529289.928134:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782529289.928174:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529289.928182:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782529289.928231:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117255552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529289.928300:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529289.928391:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117255552 00000100:00100000:3.0:1782529289.928400:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117255552 00000100:00100000:3.0:1782529289.928448:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782529289.928457:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6456c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3294:x1869117117255552:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1782529289.928463:0:5779:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782529289 with bad export cookie 8268569371952724009 00010000:00010000:0.0:1782529289.929474:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529289.929486:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c647d01600/0x72bfdc08f7eabb47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bfdc08f7eabb4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529289.929501:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529289.929503:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529289.929505:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529289.938207:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6456c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3294:x1869117117255552:12345-0@lo:103:ldlm_bl.0 Request processed in 9740us (9897us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782529289.938225:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1782529289.938441:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782529289.938446:0:3294:0:(import.c:65:import_set_state_nolock()) ffff99c645ab4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1782529289.938450:0:3294:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1782529289.944501:0:3294:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.150@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1782529289.944507:0:3294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1782529289.944516:0:3294:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff99c678319500 x1869117117255040/t0(0) o400->MGC192.168.202.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782529303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529289.944543:0:3294:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff99c643967480 x1869117117255552/t0(0) o103->MGC192.168.202.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782529305 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1782529289.944553:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1782529289.944557:0:3294:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1782529289.944558:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1782529289.944562:0:3294:0:(import.c:65:import_set_state_nolock()) ffff99c645ab4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782529289.944567:0:3294:0:(import.c:512:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 118 00000100:00080000:1.0:1782529289.944576:0:3294:0:(import.c:626:import_select_connection()) MGC192.168.202.150@tcp: import ffff99c645ab4800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1782529289.944895:0:3294:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67fae4e00 x1869117117255680/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782529289.944933:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:adf301ee-99ae-4756-993e-d61f1989f0b8:3294:1869117117255552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529289.944950:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:adf301ee-99ae-4756-993e-d61f1989f0b8:3293:1869117117255680:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1782529289.945002:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869117117255680 offset 0 length 520: 4 00000100:00100000:0.0:1782529289.945105:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:adf301ee-99ae-4756-993e-d61f1989f0b8:3295:1869117117255040:0@lo:400:kworker.0 00010000:00010000:0.0:1782529290.695063:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529291.719034:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782529292.358963:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782529292.358975:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782529292.359141:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117255808:0@lo:400:kworker.0 00000400:00000100:2.0:1782529292.359194:0:3295:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869117117255808 offset 0 length 224: 4 00010000:00010000:0.0:1782529292.743276:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529293.767465:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782529294.406968:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782529294.406978:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782529294.407095:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529294.410267:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117255936:0@lo:400:kworker.0 00000400:00000100:3.0:1782529294.410327:0:3297:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869117117255936 offset 0 length 224: 4 00010000:00010000:0.0:1782529294.791043:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529295.815130:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529296.841581:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529297.863016:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529298.886988:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529299.527034:0:3293:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782529289/real 1782529289] req@ffff99c67fae4e00 x1869117117255680/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782529299 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529299.527087:0:3293:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99c67fae4e00 x1869117117255680/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782529299 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529299.527099:0:3293:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782529289/real 1782529289] req@ffff99c67831ad80 x1869117117255424/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782529299 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529299.527111:0:3293:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99c67831ad80 x1869117117255424/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782529299 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782529299.527133:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c645ab4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782529299.527167:0:3293:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1782529299.527171:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:adf301ee-99ae-4756-993e-d61f1989f0b8:3293:1869117117255680:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1782529299.527178:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c67f623000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782529299.527192:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3293:1869117117255424:0@lo:39:umount.0 00000100:00080000:2.0:1782529299.527379:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782529299.527410:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1782529299.527413:0:38:0:(import.c:65:import_set_state_nolock()) ffff99c645ab4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782529299.527419:0:38:0:(import.c:512:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 351 00000100:00080000:2.0:1782529299.527426:0:38:0:(import.c:591:import_select_connection()) MGC192.168.202.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782529299.527435:0:38:0:(import.c:626:import_select_connection()) MGC192.168.202.150@tcp: import ffff99c645ab4800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1782529299.527477:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67fae4380 x1869117117256064/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782529299.527565:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529299.527579:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117256192:0@lo:400:kworker.0 00000400:00000100:2.0:1782529299.527644:0:3296:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869117117256192 offset 0 length 224: 4 00000100:00100000:0.0:1782529299.527897:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:adf301ee-99ae-4756-993e-d61f1989f0b8:3293:1869117117256064:0@lo:250:kworker.0 00000400:00000100:0.0:1782529299.527920:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869117117256064 offset 0 length 520: 4 00000100:00080000:1.0:1782529299.528142:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782529299.528148:0:13047:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782529299.528154:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782529299.529636:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529299.533401:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529299.533423:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529299.533431:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529299.533486:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529299.533497:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529299.533505:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529299.533512:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529299.533520:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529299.533568:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782529299.533574:0:13047:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1782529299.533616:0:13047:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1782529299.533622:0:13047:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1782529299.533628:0:13047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782529299.533646:0:13047:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782529299.533652:0:13047:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff99c67f363380) has no exports 00010000:00010000:3.0:1782529299.533681:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782529299.533692:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529299.533703:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972a800 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529299.533707:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529299.533723:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529299.533732:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529299.533738:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782529299.533742:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1782529299.533745:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1782529299.533764:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99c645ab4800 00010000:00010000:3.0:1782529299.533769:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529299.533777:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972a800/0x72bfdc08f7eabb55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabb5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529299.533805:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782529299.533819:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529299.533825:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529299.533828:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529299.533875:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529299.533882:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529299.533887:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782529299.533890:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782529299.533893:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782529299.533901:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99c645ab4800 00010000:00010000:3.0:1782529299.533904:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529299.533911:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c6587c7000/0x72bfdc08f7eabd8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabd93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529299.533921:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529299.533923:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529299.533925:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529299.534167:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782529299.534297:0:13047:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff99c67f363380) has no exports 00000020:01000000:1.0:1782529299.540154:0:13047:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99c647ea8d20 - data ffff99c671071e58/ffff99c67f5d5c00 00000020:01000000:1.0:1782529299.540372:0:13047:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99c66955e180 - data ffff99c6710706c0/ffff99c67f777000 00100000:10000000:1.0:1782529299.562889:0:13047:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1782529299.610926:0:13047:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab964 00000020:00000080:1.0:1782529299.610940:0:13047:0:(genops.c:906:class_export_put()) final put ffff99c67f35d000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1782529299.610967:0:13047:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c6795ce000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1782529299.610972:0:13047:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c6795ce000 2 00000020:01000004:1.0:1782529299.610976:0:13047:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99c6795ce000 from lustre-OST0000 00000020:00000080:1.0:1782529299.611024:0:13047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782529299.611039:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1782529299.611042:0:13047:0:(genops.c:906:class_export_put()) final put ffff99c67f35c800/lustre-OST0000_UUID 00000020:00000080:1.0:1782529299.611046:0:13047:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f35c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1782529299.611055:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1782529299.611110:0:13047:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1782529299.611115:0:13047:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1782529299.611120:0:13047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782529299.611126:0:13047:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782529299.611135:0:13047:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99c67f624000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782529299.611141:0:13047:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff99c67f360000) has exports, disconnecting them 00000020:00080000:1.0:1782529299.611147:0:13047:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99c67f624000), last request at 1782529073 00000020:00000080:1.0:1782529299.611171:0:13047:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab98e 00000020:00080000:1.0:1782529299.611181:0:13047:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99c67f624000): rc 0 00000020:00000080:1.0:1782529299.611187:0:13047:0:(genops.c:906:class_export_put()) final put ffff99c67f624000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782529299.612015:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f35d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1782529299.612038:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f624000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1782529299.612887:0:13047:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1782529299.612895:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782529299.612918:0:13047:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782529299.612927:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782529299.613102:0:13047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782529299.613112:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1782529299.613121:0:13047:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c6795ce000 1 00000020:00000080:0.0:1782529299.613128:0:13047:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab91e 00000020:00000080:0.0:1782529299.613138:0:13047:0:(genops.c:906:class_export_put()) final put ffff99c646b3f800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1782529299.613145:0:13047:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1782529299.613150:0:13047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782529299.613154:0:13047:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782529299.613159:0:13047:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff99c645a43380) has no exports 00000020:00000080:3.0:1782529299.613253:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c67f623000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782529299.613261:0:38:0:(genops.c:906:class_export_put()) final put ffff99c67f35f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1782529299.613264:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f35f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1782529299.613270:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1782529299.613367:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99c646b3f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1782529299.647801:0:13047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782529299.647824:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1782529299.647859:0:13047:0:(genops.c:906:class_export_put()) final put ffff99c6795cf000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1782529299.647866:0:13047:0:(genops.c:865:class_export_destroy()) destroying export ffff99c6795cf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1782529299.647881:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1782529299.650013:0:13047:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff99c6795cc800 00000020:02000400:3.0:1782529299.650082:0:13047:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1782529299.912745:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529300.935099:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529301.959034:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529302.985084:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782529303.152624:0:13200:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782529303.164390:0:13200:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1782529303.164509:0:13200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529303.164529:0:13200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529303.164537:0:13200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529303.164546:0:13200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529303.164579:0:13200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782529303.164587:0:13200:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782529303.164615:0:13200:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782529303.164630:0:13200:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff99c678318380 x1869117117255296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529303.164657:0:13200:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff99c67831b800 x1869117117255808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529308 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529303.164677:0:13200:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff99c67831bb80 x1869117117255936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529303.164691:0:13200:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff99c67fae6d80 x1869117117256192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529315 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529303.164700:0:13200:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782529303.164726:0:13200:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782529303.164759:0:13200:0:(import.c:65:import_set_state_nolock()) ffff99c6783bc000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782529303.165001:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117256192:0@lo:400:kworker.0 00000100:00100000:0.0:1782529303.165014:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117255296:0@lo:400:kworker.0 00000100:00100000:0.0:1782529303.165060:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3293:1869117117256320:0@lo:39:umount.0 00000400:00000100:0.0:1782529303.165125:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869117117256320 offset 0 length 224: 4 00000100:00100000:2.0:1782529303.165221:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117255808:0@lo:400:kworker.0 00010000:00010000:3.0:1782529303.166000:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782529303.166012:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529303.166022:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031800 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529303.166026:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529303.166034:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529303.166040:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529303.166045:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782529303.166047:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782529303.166062:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782529303.166078:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99c645ab4800 00010000:00010000:3.0:1782529303.166081:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529303.166086:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c640031800/0x72bfdc08f7eabb2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabb32 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529303.166095:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529303.166097:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529303.166098:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529303.166121:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1869117117255936:0@lo:400:kworker.0 00010000:00010000:3.0:1782529304.010154:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782529304.652422:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782529304.652440:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1782529305.032749:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529306.057666:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529307.079147:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529308.103223:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529309.127264:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782529309.767109:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782529309.767134:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) adf301ee-99ae-4756-993e-d61f1989f0b8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1782529310.151774:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529311.175544:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529312.201906:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529313.225014:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529313.415998:0:3293:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782529303/real 1782529303] req@ffff99c678318e00 x1869117117256320/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782529313 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529313.416039:0:3293:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99c678318e00 x1869117117256320/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782529313 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782529313.416061:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6783bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782529313.416085:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3293:1869117117256320:0@lo:39:umount.0 00000100:00080000:1.0:1782529313.416192:0:13200:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782529313.416198:0:13200:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782529313.416204:0:13200:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782529313.417322:0:13200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529313.417342:0:13200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529313.417350:0:13200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529313.417356:0:13200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529313.417389:0:13200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529313.417398:0:13200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529313.420629:0:13200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529313.420649:0:13200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529313.420686:0:13200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529313.420730:0:13200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782529313.420738:0:13200:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1782529313.420785:0:13200:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1782529313.421218:0:13200:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1782529313.421228:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782529313.421238:0:13200:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782529313.421244:0:13200:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99c67f364d40) has no exports 00000020:00080000:1.0:1782529313.421285:0:13200:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99c67f364d40) has no exports 00010000:00010000:3.0:1782529313.421540:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782529313.421550:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529313.421560:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c65972ba00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529313.421564:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529313.421574:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529313.421592:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529313.421598:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782529313.421601:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1782529313.421604:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1782529313.421621:0:5782:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99c645ab4800 00010000:00010000:3.0:1782529313.421626:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529313.421632:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972ba00/0x72bfdc08f7eabb39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabb40 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529313.421649:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782529313.421653:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529313.421660:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6000 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529313.421662:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529313.421668:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529313.421675:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529313.421680:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782529313.421682:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782529313.421691:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782529313.421697:0:5782:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99c645ab4800 00010000:00010000:3.0:1782529313.421700:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529313.421707:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c6587c6000/0x72bfdc08f7eabd7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabd85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529313.421722:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529313.421724:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529313.421726:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529313.421807:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782529313.428403:0:13200:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99c647ea8a20 - data ffff99c67fc17bd0/ffff99c67f5d5400 00000020:01000000:1.0:1782529313.428693:0:13200:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99c647ea8660 - data ffff99c67fc8d5e8/ffff99c645bce000 00100000:10000000:1.0:1782529313.438540:0:13200:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1782529313.458671:0:13200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eaba2f 00000020:00000080:2.0:1782529313.458683:0:13200:0:(genops.c:906:class_export_put()) final put ffff99c677946000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1782529313.458709:0:13200:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c67f60f000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1782529313.458714:0:13200:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c67f60f000 2 00000020:01000004:2.0:1782529313.458718:0:13200:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99c67f60f000 from lustre-OST0001 00000020:00000080:2.0:1782529313.458764:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529313.458777:0:13200:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1782529313.458781:0:13200:0:(genops.c:906:class_export_put()) final put ffff99c646095000/lustre-OST0001_UUID 00000020:00000080:2.0:1782529313.458784:0:13200:0:(genops.c:865:class_export_destroy()) destroying export ffff99c646095000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1782529313.458805:0:13200:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1782529313.458938:0:13200:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import adf301ee-99ae-4756-993e-d61f1989f0b8->MGS 00010000:00010000:2.0:1782529313.458958:0:13200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eab948 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529313.458972:0:13200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eab948 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529313.458991:0:13200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1782529313.458994:0:13200:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1782529313.458998:0:13200:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1782529313.459016:0:13200:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99c645ab4800 00010000:00010000:2.0:1782529313.459020:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c65972ae00/0x72bfdc08f7eab941 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eab948 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529313.459036:0:13200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bfdc08f7eabb86 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529313.459044:0:13200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bfdc08f7eabb86 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529313.459049:0:13200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782529313.459052:0:13200:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1782529313.459053:0:13200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1782529313.459061:0:13200:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99c645ab4800 00010000:00010000:2.0:1782529313.459063:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c640030e00/0x72bfdc08f7eabb7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bfdc08f7eabb86 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782529313.459080:0:13200:0:(import.c:65:import_set_state_nolock()) ffff99c645ab4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1782529313.459084:0:13200:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1782529313.459087:0:13200:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1782529313.459089:0:13200:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1782529313.459093:0:13200:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1782529313.459106:0:13200:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff99c67fae4380 x1869117117256064/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782529314 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1782529313.459123:0:13200:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1782529313.459127:0:13200:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:2.0:1782529313.459167:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:adf301ee-99ae-4756-993e-d61f1989f0b8:3293:1869117117256064:0@lo:250:kworker.0 10000000:01000000:2.0:1782529313.459217:0:13200:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1782529313.459225:0:13200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab822 00000020:00000080:2.0:1782529313.459230:0:13200:0:(genops.c:906:class_export_put()) final put ffff99c645ab6000/adf301ee-99ae-4756-993e-d61f1989f0b8 00000020:01000000:2.0:1782529313.459236:0:13200:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.202.150@tcp (flags='') 00000020:00000080:2.0:1782529313.459240:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529313.459245:0:13200:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782529313.459250:0:13200:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff99c6457b19c0) has no exports 10000000:01000000:3.0:1782529313.459438:0:5791:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1782529313.459636:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c677946000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1782529313.459653:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c645ab6000/adf301ee-99ae-4756-993e-d61f1989f0b8 for MGC192.168.202.150@tcp 10000000:01000000:2.0:1782529313.459703:0:13200:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.150@tcp: client import never connected 00000100:00080000:2.0:1782529313.459706:0:13200:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1782529313.459709:0:13200:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1782529313.459711:0:13200:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1782529313.459713:0:13200:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1782529313.459760:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529313.459766:0:13200:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.150@tcp (uuid adf301ee-99ae-4756-993e-d61f1989f0b8) 00000020:01000000:2.0:1782529313.459771:0:13200:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1782529313.459775:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529313.459778:0:13200:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782529313.459783:0:13200:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99c677940800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:0.0:1782529313.459910:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c645ab4800 for MGC192.168.202.150@tcp 00000020:00000080:0.0:1782529313.459917:0:37:0:(genops.c:906:class_export_put()) final put ffff99c645ab1800/adf301ee-99ae-4756-993e-d61f1989f0b8 00000020:00000080:0.0:1782529313.459920:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c645ab1800/adf301ee-99ae-4756-993e-d61f1989f0b8 for MGC192.168.202.150@tcp 00000020:01000000:0.0:1782529313.459924:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.150@tcp (adf301ee-99ae-4756-993e-d61f1989f0b8) 00000020:00080000:2.0:1782529313.460287:0:13200:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff99c680cf19c0) has exports, disconnecting them 00000020:00080000:2.0:1782529313.460294:0:13200:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99c677940800), last request at 1782529095 00000020:00000080:2.0:1782529313.460300:0:13200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eaba59 00000020:00080000:2.0:1782529313.460316:0:13200:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99c677940800): rc 0 00000020:00000080:2.0:1782529313.460321:0:13200:0:(genops.c:906:class_export_put()) final put ffff99c677940800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1782529313.460943:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c677940800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1782529313.461940:0:13200:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1782529313.461950:0:13200:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782529313.461955:0:13200:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782529313.461963:0:13200:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782529313.462034:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1782529313.462175:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1782529313.462308:0:5776:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99c648509200:5776] 0 exiting: rc = 1 00000100:00100000:0.0:1782529313.462438:0:5777:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99c650253000:5777] 1 exiting: rc = 0 00000020:00000080:0.0:1782529313.462482:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99c6783bc000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1782529313.466987:0:7496:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_002: service thread [ffff99c67f23b400:7496] 2 exiting: rc = 0 00000100:00100000:0.0:1782529313.467353:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.467668:0:5778:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99c650253a00:5778] 0 exiting: rc = 1 00000100:00100000:3.0:1782529313.467792:0:8316:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99c67839bc00:8316] 3 exiting: rc = 0 00000100:00100000:3.0:1782529313.467907:0:5779:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99c650253400:5779] 1 exiting: rc = 0 00000100:00100000:3.0:1782529313.468984:0:5780:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99c6438a0600:5780] 2 exiting: rc = 0 00000100:00100000:0.0:1782529313.469140:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469149:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469154:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469161:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469168:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469174:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469181:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469197:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469206:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469212:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469219:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469230:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469237:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469243:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469253:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469260:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469269:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469276:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469282:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469288:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469295:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469301:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469324:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469329:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469336:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469341:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469346:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469351:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469357:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469364:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469369:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469376:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469381:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469387:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469392:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469399:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469405:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469412:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469418:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469423:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469429:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469435:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469440:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469445:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469452:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469459:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469465:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469471:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469477:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469483:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469489:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469495:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469503:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469509:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469515:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469520:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469527:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469541:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469548:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469554:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469560:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469566:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469572:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.469579:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1782529313.470592:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782529313.470607:0:13200:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1782529313.470615:0:13200:0:(genops.c:906:class_export_put()) final put ffff99c680356800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1782529313.470621:0:13200:0:(genops.c:865:class_export_destroy()) destroying export ffff99c680356800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1782529313.470629:0:13200:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1782529313.470686:0:13200:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c67f60f000 1 00000020:00000080:0.0:1782529313.470693:0:13200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72bfdc08f7eab9fe 00000020:00000080:0.0:1782529313.470702:0:13200:0:(genops.c:906:class_export_put()) final put ffff99c67f60f800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1782529313.470722:0:13200:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1782529313.470728:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782529313.470734:0:13200:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782529313.470738:0:13200:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99c645a40000) has no exports 00000020:00000080:3.0:1782529313.470866:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f60f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1782529313.497702:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529313.497729:0:13200:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1782529313.497737:0:13200:0:(genops.c:906:class_export_put()) final put ffff99c67f60d800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1782529313.497744:0:13200:0:(genops.c:865:class_export_destroy()) destroying export ffff99c67f60d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1782529313.497755:0:13200:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1782529313.498055:0:13200:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff99c67f60e800 00000020:01000000:2.0:1782529313.498088:0:13200:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1782529313.498104:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782529313.498109:0:13200:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782529313.498114:0:13200:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff99c6457b4d40) has no exports 00000020:00000080:2.0:1782529313.498144:0:13200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782529313.498151:0:13200:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1782529313.498155:0:13200:0:(genops.c:906:class_export_put()) final put ffff99c646b3b000/OSS_uuid 00000020:00000080:2.0:1782529313.498158:0:13200:0:(genops.c:865:class_export_destroy()) destroying export ffff99c646b3b000/OSS_uuid for OSS 00000020:01000000:2.0:1782529313.498167:0:13200:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1782529313.498278:0:6592:0:(service.c:3182:ptlrpc_main()) ll_ost00_001: service thread [ffff99c667195800:6592] 1 exiting: rc = 0 00000100:00100000:2.0:1782529313.499291:0:6591:0:(service.c:3182:ptlrpc_main()) ll_ost00_000: service thread [ffff99c65023de00:6591] 0 exiting: rc = 1 00000100:00080000:3.0:1782529313.499435:0:5790:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1782529313.499571:0:8328:0:(service.c:3182:ptlrpc_main()) ll_ost00_003: service thread [ffff99c67f282e00:8328] 3 exiting: rc = 0 00000100:00100000:1.0:1782529313.499994:0:6593:0:(service.c:3182:ptlrpc_main()) ll_ost00_002: service thread [ffff99c667195e00:6593] 2 exiting: rc = 0 00000100:00100000:2.0:1782529313.501174:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501206:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501215:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501222:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501227:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501233:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501239:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501244:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501251:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501257:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501262:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501267:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501273:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501279:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501284:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501289:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501295:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501300:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501306:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501328:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501335:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501340:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501346:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501353:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501359:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501380:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501386:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501391:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501397:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501404:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501410:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501416:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501422:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501427:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501433:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501441:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501448:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501455:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501461:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501466:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501472:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501478:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501484:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501490:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501495:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501501:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501506:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501511:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501516:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501521:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501526:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501531:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501539:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501544:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501551:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501557:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501566:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501576:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501584:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501590:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501603:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501609:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501615:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.501621:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782529313.503036:0:6595:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99c646bd5000:6595] 1 exiting: rc = 0 00000100:00100000:1.0:1782529313.503124:0:6594:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99c667194800:6594] 0 exiting: rc = 1 00000100:00100000:0.0:1782529313.503235:0:10761:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99c67fb52c00:10761] 2 exiting: rc = 0 00000100:00100000:2.0:1782529313.505011:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505023:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505029:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505036:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505041:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505046:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505052:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505058:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505064:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505071:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505076:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505081:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505086:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505091:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505096:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505103:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505108:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505113:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505119:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505125:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505131:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505136:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505142:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505148:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505154:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505159:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505164:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505170:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505176:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505194:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505201:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505225:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505230:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505236:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505241:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505247:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505253:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505259:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505267:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505273:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505280:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505286:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505291:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505297:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505303:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505309:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505315:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505321:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505327:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505332:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505339:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505346:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505357:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505363:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505371:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505378:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505384:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505390:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505396:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505402:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505407:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505412:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505417:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.505424:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782529313.506592:0:6598:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99c667194000:6598] 2 exiting: rc = 0 00000100:00100000:3.0:1782529313.506873:0:6597:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99c667195c00:6597] 1 exiting: rc = 0 00000100:00100000:1.0:1782529313.508416:0:6596:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99c667195400:6596] 0 exiting: rc = 1 00000100:00100000:2.0:1782529313.510237:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510252:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510279:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510285:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510292:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510299:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510306:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510384:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510392:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510401:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510410:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510417:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510424:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510431:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510441:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510453:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510459:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510466:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510474:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510480:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510488:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510497:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510504:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510575:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510586:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510594:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510602:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510608:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510614:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510621:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510628:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510635:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510642:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510649:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510657:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510664:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510670:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510688:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510695:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510703:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510709:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510716:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510722:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510730:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510736:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510743:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510751:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510774:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510783:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510790:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510949:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510956:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510963:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510970:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510977:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510984:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510991:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.510998:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.511006:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.511013:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.511019:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.511026:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.511033:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.511049:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.524972:0:6600:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99c6457f2e00:6600] 1 exiting: rc = 0 00000100:00100000:2.0:1782529313.525979:0:6599:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99c667194a00:6599] 0 exiting: rc = 1 00000100:00100000:0.0:1782529313.526245:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526253:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526259:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526265:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526271:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526277:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526282:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526288:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526294:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526321:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526331:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526337:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526359:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526365:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526371:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526376:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526381:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526387:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526393:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526398:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526404:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526410:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526417:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526422:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526427:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526433:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526440:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526448:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526453:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526459:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526465:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526471:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526478:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526483:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526488:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526494:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526499:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526504:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526510:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526515:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526521:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526527:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526533:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526539:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526544:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526550:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526555:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526570:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526576:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526581:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526588:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526593:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526599:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526604:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526610:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526615:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526621:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526627:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526633:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526638:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526644:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526650:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526655:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782529313.526661:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.527719:0:6601:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99c64503a600:6601] 0 exiting: rc = 1 00000100:00100000:0.0:1782529313.528054:0:6602:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99c64503a000:6602] 1 exiting: rc = 0 00000100:00100000:2.0:1782529313.528191:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528200:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528215:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528224:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528232:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528240:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528263:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528270:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528277:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528284:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528292:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528386:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528395:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528403:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528410:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528417:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528426:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528433:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528442:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528452:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528459:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528466:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528473:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528494:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528502:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528510:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528518:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528526:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528532:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528539:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528546:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528553:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528560:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528566:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528575:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528599:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528609:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528618:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528627:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528637:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528645:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528661:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528671:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528680:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528686:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528695:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528704:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528728:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528737:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528748:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528755:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528762:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528769:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528776:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528788:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528809:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528817:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528823:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528829:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528879:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528899:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528917:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528924:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782529313.528937:0:13200:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1782529313.545135:0:13200:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1782529332.639353:0:13821:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1782529340.919684:0:14233:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782529340.919689:0:14233:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1782529340.919794:0:14233:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99c67f8f1800 00000020:01000004:3.0:1782529340.919808:0:14233:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1782529340.919816:0:14233:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782529340.919850:0:14233:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99c645a43380) 00000020:00000080:3.0:1782529340.919863:0:14233:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782529340.945092:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782529340.947349:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1782529340.947778:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 512: rc = 0 00100000:10000000:3.0:1782529340.949765:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 512: rc = 0 00100000:10000000:3.0:1782529340.949924:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 512: rc = 0 00100000:10000000:3.0:1782529340.950056:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 512: rc = 0 00100000:10000000:3.0:1782529340.950277:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782529340.950352:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 512: rc = 0 00100000:10000000:3.0:1782529340.950467:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 512: rc = 0 00100000:10000000:2.0:1782529340.951781:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 514: rc = 0 00100000:10000000:2.0:1782529340.953033:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 460: rc = 0 00100000:10000000:2.0:1782529340.953139:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 460: rc = 0 00100000:10000000:2.0:1782529340.955825:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 653: rc = 0 00100000:10000000:2.0:1782529340.956241:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 653: rc = 0 00100000:10000000:2.0:1782529340.956485:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 653: rc = 0 00100000:10000000:2.0:1782529340.957644:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 653: rc = 0 00100000:10000000:2.0:1782529340.957992:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 653: rc = 0 00100000:10000000:2.0:1782529340.958247:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 653: rc = 0 00100000:10000000:2.0:1782529340.958493:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 653: rc = 0 00100000:10000000:2.0:1782529340.958754:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 653: rc = 0 00100000:10000000:2.0:1782529340.959064:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 653: rc = 0 00100000:10000000:2.0:1782529340.959306:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 653: rc = 0 00100000:10000000:2.0:1782529340.959550:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 653: rc = 0 00100000:10000000:2.0:1782529340.959809:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 653: rc = 0 00100000:10000000:2.0:1782529340.960261:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 272: rc = 0 00100000:10000000:2.0:1782529340.960497:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 272: rc = 0 00100000:10000000:2.0:1782529340.960758:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 272: rc = 0 00100000:10000000:2.0:1782529340.963738:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 272: rc = 0 00100000:10000000:2.0:1782529340.964152:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 272: rc = 0 00100000:10000000:2.0:1782529340.964417:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 272: rc = 0 00100000:10000000:2.0:1782529340.964827:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 272: rc = 0 00100000:10000000:2.0:1782529340.965399:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 272: rc = 0 00100000:10000000:2.0:1782529340.965661:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 272: rc = 0 00100000:10000000:2.0:1782529340.965916:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 272: rc = 0 00100000:10000000:2.0:1782529340.966188:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 272: rc = 0 00100000:10000000:2.0:1782529340.966427:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 272: rc = 0 00100000:10000000:2.0:1782529340.966673:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 272: rc = 0 00100000:10000000:2.0:1782529340.967262:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 272: rc = 0 00100000:10000000:2.0:1782529340.967532:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 272: rc = 0 00100000:10000000:2.0:1782529340.967882:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 272: rc = 0 00100000:10000000:2.0:1782529340.968131:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 272: rc = 0 00100000:10000000:2.0:1782529340.968371:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 272: rc = 0 00100000:10000000:2.0:1782529340.969983:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 272: rc = 0 00100000:10000000:2.0:1782529340.970280:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 272: rc = 0 00100000:10000000:2.0:1782529340.970531:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 272: rc = 0 00100000:10000000:2.0:1782529340.971257:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 272: rc = 0 00100000:10000000:2.0:1782529340.971658:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 272: rc = 0 00100000:10000000:2.0:1782529340.972058:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 272: rc = 0 00100000:10000000:2.0:1782529340.972327:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 272: rc = 0 00100000:10000000:2.0:1782529340.972819:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 272: rc = 0 00100000:10000000:2.0:1782529340.973112:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 272: rc = 0 00100000:10000000:2.0:1782529340.973368:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 272: rc = 0 00100000:10000000:2.0:1782529340.974071:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 272: rc = 0 00100000:10000000:2.0:1782529340.974317:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 272: rc = 0 00100000:10000000:2.0:1782529340.975466:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 272: rc = 0 00100000:10000000:2.0:1782529340.975815:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 272: rc = 0 00100000:10000000:2.0:1782529340.976222:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 472: rc = 0 00100000:10000000:2.0:1782529340.979875:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1782529340.980087:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 461: rc = 0 00100000:10000000:2.0:1782529340.980316:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1782529340.980391:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 461: rc = 0 00100000:10000000:2.0:1782529340.980786:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1782529340.981087:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 461: rc = 0 00100000:10000000:2.0:1782529340.982139:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1782529340.982234:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 269: rc = 0 00100000:10000000:2.0:1782529340.983045:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1782529340.983126:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 269: rc = 0 00100000:10000000:2.0:1782529340.983315:0:14233:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1782529340.983382:0:14233:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 269: rc = 0 00000020:00000080:3.0:1782529340.984064:0:14233:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1782529340.984073:0:14233:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782529340.984083:0:14233:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eacb23 00000020:01000004:3.0:1782529340.984093:0:14233:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1782529340.984098:0:14233:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1782529340.984103:0:14233:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99c67f8f1800 from MGS 00000020:01000004:3.0:1782529340.984108:0:14233:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1782529340.984118:0:14233:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99c645a419c0) 00000020:00000080:3.0:1782529340.984127:0:14233:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1782529340.984179:0:14233:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c67f8f1800 from MGS, refs=2 00080000:01000000:3.0:1782529340.984183:0:14233:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782529340.984188:0:14233:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eacb31 00000100:00100000:3.0:1782529340.984286:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1782529340.984406:0:14233:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1782529340.984412:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1782529340.997598:0:14233:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1782529340.997624:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782529340.998530:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782529340.998714:0:14233:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782529340.998719:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1782529341.000940:0:14233:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1782529341.000965:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782529341.001529:0:14233:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782529341.001537:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1782529341.002395:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529341.002398:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529341.002400:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529341.018205:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529341.018229:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529341.018232:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529341.026302:0:14233:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1782529341.029121:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1782529341.043825:0:14233:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1782529341.043930:0:14233:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782529341.043933:0:14233:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1782529341.052519:0:14242:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1782529341.052769:0:14233:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1782529341.052931:0:14233:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782529341.053524:0:14233:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1782529341.053944:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529341.054162:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1782529341.054169:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1782529341.058192:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1782529341.058205:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1782529341.062174:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782529341.062189:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1782529341.068776:0:14233:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782529341.068802:0:14233:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.150@tcp' 00000020:01000004:1.0:1782529341.068804:0:14233:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782529341.068867:0:14233:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.150@tcp (typ=mgc) 00000020:00000080:1.0:1782529341.068882:0:14233:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.150@tcp (ffff99c67f363380) 00000020:00000080:1.0:1782529341.068898:0:14233:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782529341.069005:0:14233:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c67f8f4800@MGC192.168.202.150@tcp: add connection 192.168.202.150@tcp at head 00000100:00080000:0.0:1782529341.069103:0:14247:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1782529341.069181:0:14233:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.150@tcp-0 is initialized 00000040:01000000:1.0:1782529341.069187:0:14233:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 1 is initialized 10000000:01000000:3.0:1782529341.071362:0:14248:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1782529341.071434:0:14233:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.150@tcp (uuid 9dec586b-6fd4-4acc-b993-13a64cbeab0a) 00000020:00000080:1.0:1782529341.071458:0:14233:0:(genops.c:1406:class_connect()) connect: client 9dec586b-6fd4-4acc-b993-13a64cbeab0a, cookie 0x72bfdc08f7eacb3f 00000100:00080000:1.0:1782529341.071471:0:14233:0:(import.c:512:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782529341.071478:0:14233:0:(import.c:626:import_select_connection()) MGC192.168.202.150@tcp: import ffff99c67f8f4800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529341.071511:0:14233:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c678319180 x1869117117256448/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782529341.071540:0:14233:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 9dec586b-6fd4-4acc-b993-13a64cbeab0a->MGS 00000020:01000004:1.0:1782529341.071567:0:14233:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782529341.071573:0:14233:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782529341.071585:0:14233:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99c67f3619c0) 00000020:00000080:1.0:1782529341.071595:0:14233:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782529341.072066:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3293:1869117117256448:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1782529341.072134:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529341.072220:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117256448 00000100:00100000:3.0:1782529341.072227:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117256448 00000100:00100000:3.0:1782529341.072265:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782529341.072272:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3293:x1869117117256448:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1782529341.072296:0:14244:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9dec586b-6fd4-4acc-b993-13a64cbeab0a@0@lo t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1782529341.072315:0:14244:0:(genops.c:1406:class_connect()) connect: client 9dec586b-6fd4-4acc-b993-13a64cbeab0a, cookie 0x72bfdc08f7eacb4d 00000100:00080000:3.0:1782529341.072436:0:14244:0:(import.c:65:import_set_state_nolock()) ffff99c680353800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782529341.072488:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+5:3293:x1869117117256448:12345-0@lo:250:mount.lustre.0 Request processed in 214us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.072496:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529341.072598:0:3293:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782529341.072606:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.150@tcp: connect to target with instance 0 00000100:00080000:2.0:1782529341.072613:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782529341.072618:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782529341.072620:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c67f8f4800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782529341.072623:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782529341.072637:0:3293:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782529341.072644:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3293:1869117117256448:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1782529341.100360:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529341.100547:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782529341.100553:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1782529341.102429:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1782529341.102440:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1782529341.102773:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1782529341.102780:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1782529341.103536:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529341.103691:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1782529341.103697:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1782529341.104244:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1782529341.104251:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782529341.161677:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782529341.162271:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782529341.162279:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1782529341.163605:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1782529341.163615:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1782529341.165687:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529341.165884:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782529341.165890:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1782529341.166475:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782529341.166487:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782529341.167745:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529341.168046:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782529341.168054:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1782529341.168513:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782529341.168519:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782529341.169251:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529341.169387:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782529341.169392:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782529341.174398:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782529341.174409:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782529341.203824:0:14233:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782529341.204225:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782529341.204231:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782529341.206239:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782529341.206252:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782529341.207061:0:14233:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782529341.207068:0:14233:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782529341.208006:0:14233:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1782529341.208033:0:14233:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1782529341.208039:0:14233:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1782529341.208177:0:14233:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782529341.208221:0:14233:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1782529341.208226:0:14233:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782529341.208228:0:14233:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529341.208230:0:14233:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529341.208231:0:14233:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529341.208232:0:14233:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529341.208233:0:14233:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529341.208235:0:14233:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529341.208236:0:14233:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529341.208242:0:14233:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529341.208243:0:14233:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782529341.208246:0:14233:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1782529341.208248:0:14233:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782529341.208249:0:14233:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529341.208250:0:14233:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529341.208250:0:14233:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529341.208251:0:14233:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529341.208252:0:14233:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529341.208253:0:14233:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529341.208254:0:14233:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529341.208255:0:14233:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529341.208255:0:14233:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782529341.208281:0:14233:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782529341.208300:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117256576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782529341.208368:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529341.208478:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.208530:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117256576 00000100:00100000:3.0:1782529341.208538:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117256576 00000100:00100000:3.0:1782529341.208619:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782529341.208629:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+5:14233:x1869117117256576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782529341.208673:0:14245:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782529341.208675:0:14245:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782529341.208682:0:14245:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1782529341.209124:0:14267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1782529341.209471:0:14245:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1782529341.210425:0:14268:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1782529341.210431:0:14268:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1782529341.210434:0:14268:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1782529341.210470:0:14268:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1782529341.210704:0:14245:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782529341.210713:0:14245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1782529341.223540:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+5:14233:x1869117117256576:12345-0@lo:253:mount.lustre.0 Request processed in 14902us (15161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.223556:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529341.223671:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117256576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782529341.223686:0:14233:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782529341.223689:0:14233:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782529341.223691:0:14233:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529341.223692:0:14233:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529341.223693:0:14233:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529341.223694:0:14233:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529341.223695:0:14233:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529341.223697:0:14233:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529341.223698:0:14233:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529341.223700:0:14233:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529341.223701:0:14233:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782529341.223723:0:14233:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99c67f8f1800 from lustre-MDT0000 10000000:01000000:2.0:1782529341.223751:0:14233:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1782529341.223754:0:14233:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782529341.223759:0:14233:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99c67f363380 10000000:01000000:2.0:1782529341.223763:0:14233:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782529341.223771:0:14233:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff99c67f363380 from 1 10000000:01000000:2.0:1782529341.223774:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782529341.223910:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529341.223923:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529341.224133:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529341.224158:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117256704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782529341.224197:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529341.224237:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.224352:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117256704 00000100:00100000:3.0:1782529341.224359:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117256704 00000100:00100000:3.0:1782529341.224400:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782529341.224408:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+5:14233:x1869117117256704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782529341.224420:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529341.224435:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044e00/0x72bfdc08f7eacb5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacb54 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.224458:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044e00/0x72bfdc08f7eacb5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacb54 expref: 6 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.224469:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044e00/0x72bfdc08f7eacb5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacb54 expref: 6 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.224478:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044e00, rc 0) 00000100:00100000:3.0:1782529341.224520:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+6:14233:x1869117117256704:12345-0@lo:101:mount.lustre.0 Request processed in 112us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.224526:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529341.224598:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117256704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529341.224611:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.224619:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.224672:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117256832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529341.224698:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.224721:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529341.224774:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117256832 00000100:00100000:2.0:1782529341.224778:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117256832 00000100:00100000:2.0:1782529341.224811:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782529341.224819:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+6:14233:x1869117117256832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782529341.225367:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+6:14233:x1869117117256832:12345-0@lo:501:mount.lustre.0 Request processed in 547us (666us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782529341.225375:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529341.225450:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117256832:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782529341.225475:0:14233:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782529341.225497:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225517:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529341.225525:0:14233:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99c67f8f1800 10000000:01000000:1.0:1782529341.225529:0:14233:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782529341.225533:0:14233:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99c67f8f1800 10000000:01000000:1.0:1782529341.225535:0:14233:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782529341.225537:0:14233:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff99c67f8f1800 from 1 10000000:01000000:1.0:1782529341.225540:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782529341.225561:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6800/0x72bfdc08f7eacb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225569:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c6800/0x72bfdc08f7eacb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225577:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c6800/0x72bfdc08f7eacb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.225591:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117256960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782529341.225618:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.225644:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117256960 00000100:00100000:1.0:1782529341.225648:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117256960 00000100:00100000:1.0:1782529341.225673:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782529341.225678:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+6:14233:x1869117117256960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529341.225686:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529341.225696:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c6587c6200/0x72bfdc08f7eacb69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacb62 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225723:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c6587c6200/0x72bfdc08f7eacb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacb62 expref: 7 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225732:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c6587c6200/0x72bfdc08f7eacb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacb62 expref: 7 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225739:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6200, rc 0) 00000100:00100000:1.0:1782529341.225764:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+7:14233:x1869117117256960:12345-0@lo:101:mount.lustre.0 Request processed in 86us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529341.225770:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782529341.225804:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529341.225816:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117256960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529341.225825:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c6800/0x72bfdc08f7eacb62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb69 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225853:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c6800/0x72bfdc08f7eacb62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacb69 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529341.225865:0:14233:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782529341.225869:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6800/0x72bfdc08f7eacb62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb69 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225874:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c6800/0x72bfdc08f7eacb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb69 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529341.225880:0:14233:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782529341.225883:0:14233:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782529341.225894:0:14233:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99c67f8f1800 10000000:01000000:1.0:1782529341.225896:0:14233:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782529341.225899:0:14233:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782529341.225901:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782529341.225923:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6e00/0x72bfdc08f7eacb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.225930:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c6e00/0x72bfdc08f7eacb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.226683:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c6e00/0x72bfdc08f7eacb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.226699:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117257088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782529341.226727:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.226752:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117257088 00000100:00100000:1.0:1782529341.226755:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117257088 00000100:00100000:1.0:1782529341.226775:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782529341.226780:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+7:14233:x1869117117257088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529341.226786:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529341.226793:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c6587c7000/0x72bfdc08f7eacb77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacb70 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.226806:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c6587c7000/0x72bfdc08f7eacb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacb70 expref: 8 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.226811:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c6587c7000/0x72bfdc08f7eacb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacb70 expref: 8 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.226816:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7000, rc 0) 00000100:00100000:1.0:1782529341.226876:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+8:14233:x1869117117257088:12345-0@lo:101:mount.lustre.0 Request processed in 94us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529341.226882:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782529341.227482:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529341.227505:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117257088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529341.227522:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c6e00/0x72bfdc08f7eacb70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb77 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.227530:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c6e00/0x72bfdc08f7eacb70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacb77 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.227580:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117257216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529341.227610:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.227680:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529341.227785:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117257216 00000100:00100000:2.0:1782529341.227790:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117257216 00000100:00100000:2.0:1782529341.227973:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782529341.227982:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+8:14233:x1869117117257216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782529341.228385:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+9:14233:x1869117117257216:12345-0@lo:501:mount.lustre.0 Request processed in 404us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529341.228392:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782529341.228493:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117257216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529341.228527:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117257344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782529341.228568:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.228817:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c5428d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.229209:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117257344 00000100:00100000:3.0:1782529341.229217:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117257344 00000100:00100000:3.0:1782529341.229249:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782529341.229257:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+9:14233:x1869117117257344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782529341.229634:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+9:14233:x1869117117257344:12345-0@lo:503:mount.lustre.0 Request processed in 376us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.229642:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782529341.229779:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117257344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782529341.230444:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14269:1869117117257472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529341.230494:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529341.230532:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.230580:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117257472 00000100:00100000:3.0:1782529341.230585:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117257472 00000100:00100000:3.0:1782529341.230650:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782529341.230657:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+9:14269:x1869117117257472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529341.231121:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+9:14269:x1869117117257472:12345-0@lo:502:llog_process_th.0 Request processed in 463us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.231128:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782529341.231492:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14269:1869117117257472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782529341.231523:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529341.231534:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.231536:0:14269:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782529341.231541:0:14269:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782529341.231544:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782529341.231558:0:14269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99c67f364d40) 00000020:00000080:1.0:1782529341.231581:0:14269:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782529341.231588:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782529341.231657:0:14269:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782529341.231665:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eacb85 00000020:00000080:1.0:1782529341.233522:0:14269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782529341.233533:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529341.233539:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.233541:0:14269:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782529341.233545:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529341.233550:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.233552:0:14269:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1782529341.233555:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782529341.233569:0:14269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99c67f360000) 00000020:00000080:1.0:1782529341.233588:0:14269:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1782529341.233593:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782529341.233595:0:14269:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1782529341.233598:0:14269:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1782529341.233604:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782529341.233661:0:14269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c67f8f1800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1782529341.233674:0:14269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99c6457b4d40) 00000020:00000080:1.0:1782529341.233683:0:14269:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1782529341.233745:0:14269:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782529341.233752:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eacb9a 00000020:00000080:1.0:1782529341.234244:0:14269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782529341.234252:0:14269:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782529341.234257:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72bfdc08f7eacba1 00080000:01000000:1.0:1782529341.234263:0:14269:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782529341.234267:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eacba8 00010000:00010000:3.0:1782529341.311612:0:14269:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1782529341.312490:0:14269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1782529341.312691:0:14269:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782529341.314987:0:14269:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99c645a40000) 00000020:00000080:3.0:1782529341.315008:0:14269:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782529341.315078:0:14269:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782529341.315085:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eacbb6 00000020:00000080:2.0:1782529341.315761:0:14269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1782529341.325195:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72bfdc08f7eacbbd 00000020:00000080:0.0:1782529341.327644:0:14269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1782529341.327657:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529341.327663:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529341.327665:0:14269:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1782529341.327669:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782529341.327676:0:14269:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1782529341.327678:0:14269:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782529341.327680:0:14269:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782529341.327682:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782529341.327684:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529341.327685:0:14269:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782529341.327688:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529341.327693:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529341.327694:0:14269:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1782529341.327698:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782529341.327743:0:14269:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1782529341.327758:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529341.327761:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529341.327762:0:14269:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1782529341.327765:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782529341.327767:0:14269:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1782529341.327770:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529341.327772:0:14269:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1782529341.327774:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782529341.327779:0:14269:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:0.0:1782529341.327805:0:14269:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1782529341.327808:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782529341.327823:0:14269:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99c680cf19c0) 00000020:00000080:0.0:1782529341.327860:0:14269:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1782529341.327868:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782529341.327923:0:14269:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1782529341.327929:0:14269:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1782529341.327936:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eacbcb 00010000:00080000:0.0:1782529341.327976:0:14269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c6772d3800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:0.0:1782529341.328202:0:14269:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1782529341.330809:0:14269:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1782529341.331340:0:14269:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1782529341.332357:0:14269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782529341.332417:0:14269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1782529341.332490:0:14269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1782529341.333430:0:14273:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782529341.333436:0:14273:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782529341.334073:0:14269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782529341.334085:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782529341.334116:0:14269:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782529341.334140:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eacbd2 00000100:00080000:1.0:1782529341.334151:0:14269:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782529341.334157:0:14269:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99c6772d3800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529341.334192:0:14269:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c678319f80 x1869117117257600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782529341.334236:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117257600:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1782529341.334294:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869117117257600 offset 0 length 520: 4 00000100:00080000:1.0:1782529341.334346:0:14269:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782529341.334415:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529341.334419:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.334421:0:14269:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782529341.334424:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782529341.334426:0:14269:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1782529341.334428:0:14269:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782529341.334429:0:14269:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782529341.334431:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782529341.334433:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.334434:0:14269:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782529341.334437:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782529341.334440:0:14269:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782529341.334443:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.334444:0:14269:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782529341.334447:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782529341.334451:0:14269:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:1.0:1782529341.334471:0:14269:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782529341.334474:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782529341.334486:0:14269:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99c6457b19c0) 00000020:00000080:1.0:1782529341.334497:0:14269:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1782529341.334501:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782529341.334555:0:14269:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782529341.334561:0:14269:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782529341.334572:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bfdc08f7eacbe0 00010000:00080000:1.0:1782529341.334629:0:14269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c6783b9000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1782529341.334818:0:14269:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1782529341.335030:0:14269:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782529341.335051:0:14269:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782529341.335601:0:14269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782529341.335666:0:14269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1782529341.335733:0:14269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1782529341.338990:0:14275:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782529341.338997:0:14275:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782529341.339806:0:14269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782529341.339818:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782529341.340551:0:14269:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782529341.340574:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eacbe7 00000100:00080000:1.0:1782529341.340585:0:14269:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782529341.340591:0:14269:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99c6783b9000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529341.340625:0:14269:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67831b480 x1869117117257728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782529341.340691:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117257728:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1782529341.340746:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869117117257728 offset 0 length 520: 4 00000100:00080000:1.0:1782529341.340803:0:14269:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782529341.340883:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529341.340887:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.340889:0:14269:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782529341.340893:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529341.340896:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.340898:0:14269:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782529341.340901:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782529341.340903:0:14269:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782529341.340905:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529341.340907:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.340908:0:14269:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782529341.340911:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529341.340913:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.340915:0:14269:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782529341.340918:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782529341.340973:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14269:1869117117257856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529341.341022:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.341039:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529341.341383:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117257856 00000100:00100000:0.0:1782529341.341391:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117257856 00000100:00100000:0.0:1782529341.341514:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782529341.341523:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+9:14269:x1869117117257856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782529341.341808:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+9:14269:x1869117117257856:12345-0@lo:502:llog_process_th.0 Request processed in 285us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529341.341816:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782529341.342476:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14269:1869117117257856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782529341.342590:0:14269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529341.342598:0:14269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529341.342600:0:14269:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782529341.342605:0:14269:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782529341.342792:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1782529341.342813:0:14233:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782529341.342919:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6e00/0x72bfdc08f7eacb70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb77 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.342930:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c6e00/0x72bfdc08f7eacb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb77 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529341.342938:0:14233:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff99c67f8f1800 from 1 10000000:01000000:1.0:1782529341.342940:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782529341.342978:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.342986:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.342996:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.343015:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117257984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782529341.343058:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.343092:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.343150:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117257984 00000100:00100000:3.0:1782529341.343156:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117257984 00000100:00100000:3.0:1782529341.343195:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782529341.343203:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c658261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+9:14233:x1869117117257984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782529341.343213:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529341.343226:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacbee expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.343248:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 10 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.343270:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 10 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.343278:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044a00, rc 0) 00000100:00100000:3.0:1782529341.343321:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c658261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+10:14233:x1869117117257984:12345-0@lo:101:mount.lustre.0 Request processed in 118us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.343327:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782529341.344425:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117257984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529341.344446:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.344471:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.345093:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258112:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782529341.345149:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.345195:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.345616:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117258112 00000100:00100000:3.0:1782529341.345623:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117258112 00000100:00100000:3.0:1782529341.345667:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782529341.345675:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c658261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+10:14233:x1869117117258112:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1782529341.345693:0:14246:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782529341.345698:0:14246:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782529341.345770:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c658261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+10:14233:x1869117117258112:12345-0@lo:256:mount.lustre.0 Request processed in 95us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.345778:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782529341.345927:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258112:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782529341.346639:0:14233:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782529341.346910:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.346922:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529341.346929:0:14233:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c67f8f1800 from 1 10000000:01000000:1.0:1782529341.346940:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529341.346980:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.346989:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.346997:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.347014:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782529341.347056:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.347102:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529341.347157:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117258240 00000100:00100000:0.0:1782529341.347162:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117258240 00000100:00100000:0.0:1782529341.347201:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782529341.347210:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c658260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+10:14233:x1869117117258240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782529341.347219:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529341.347233:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacbfc expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.347252:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.347261:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.347281:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030a00, rc 0) 00000100:00100000:0.0:1782529341.347320:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c658260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14233:x1869117117258240:12345-0@lo:101:mount.lustre.0 Request processed in 111us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529341.347325:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782529341.347446:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529341.347459:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.347467:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.347513:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529341.347535:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.347561:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529341.347605:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117258368 00000100:00100000:0.0:1782529341.347610:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117258368 00000100:00100000:0.0:1782529341.347640:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782529341.347646:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14233:x1869117117258368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782529341.348736:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14233:x1869117117258368:12345-0@lo:501:mount.lustre.0 Request processed in 1087us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529341.348746:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782529341.351573:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529341.351640:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782529341.351714:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529341.351759:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6502b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782529341.351825:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117258496 00000100:00100000:0.0:1782529341.351859:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117258496 00000100:00100000:0.0:1782529341.351922:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782529341.351940:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14233:x1869117117258496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782529341.352141:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14233:x1869117117258496:12345-0@lo:503:mount.lustre.0 Request processed in 210us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529341.352149:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782529341.352435:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782529341.353128:0:14277:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643966d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14277:1869117117258624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782529341.353177:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529341.353211:0:14277:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6806ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782529341.353251:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117258624 00000100:00100000:2.0:1782529341.353256:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117258624 00000100:00100000:2.0:1782529341.353292:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529341.353299:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14277:x1869117117258624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529341.353680:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14277:x1869117117258624:12345-0@lo:502:llog_process_th.0 Request processed in 379us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529341.353688:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782529341.354151:0:14277:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643966d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14277:1869117117258624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782529341.354251:0:14277:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782529341.354262:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529341.354264:0:14277:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782529341.354270:0:14277:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c67f8f1800 00000020:00000080:2.0:1782529341.354272:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782529341.354280:0:14277:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782529341.354282:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529341.354284:0:14277:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1782529341.354286:0:14277:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782529341.354289:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529341.354290:0:14277:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782529341.354293:0:14277:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c67f8f1800 00000020:00000080:2.0:1782529341.354295:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782529341.354387:0:14277:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782529341.354391:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529341.354393:0:14277:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1782529341.354411:0:14277:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782529341.354414:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782529341.354416:0:14277:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782529341.354420:0:14277:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99c67f8f1800 00000020:00000080:2.0:1782529341.354422:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782529341.359190:0:14277:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14277:1869117117258752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529341.359276:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529341.359324:0:14277:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645a2dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.360050:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117258752 00000100:00100000:3.0:1782529341.360060:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117258752 00000100:00100000:3.0:1782529341.360115:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782529341.360138:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14277:x1869117117258752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529341.362601:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14277:x1869117117258752:12345-0@lo:502:llog_process_th.0 Request processed in 2002us (2851us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.362617:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782529341.363537:0:14277:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14277:1869117117258752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782529341.363581:0:14277:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529341.363590:0:14277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529341.363593:0:14277:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782529341.363600:0:14277:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1782529341.365574:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1782529341.365604:0:14233:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782529341.365632:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.365657:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529341.365705:0:14233:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782529341.365708:0:14233:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99c67f8f1800 10000000:01000000:0.0:1782529341.365711:0:14233:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99c67f8f1800 10000000:01000000:0.0:1782529341.365715:0:14233:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782529341.365720:0:14233:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c67f8f1800 from 1 10000000:01000000:0.0:1782529341.365723:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782529341.365760:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030600/0x72bfdc08f7eacc0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.365768:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c640030600/0x72bfdc08f7eacc0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.365778:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c640030600/0x72bfdc08f7eacc0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529341.365801:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643964e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782529341.365881:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529341.365944:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646ae9300 going to sleep for 11 seconds 00000100:00100000:2.0:1782529341.366071:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117258880 00000100:00100000:2.0:1782529341.366079:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117258880 00000100:00100000:2.0:1782529341.366131:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782529341.366141:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14233:x1869117117258880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782529341.366157:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529341.366171:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eacc11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacc0a expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529341.366194:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eacc11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc0a expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529341.366203:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d00200/0x72bfdc08f7eacc11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc0a expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529341.366211:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00200, rc 0) 00000100:00100000:2.0:1782529341.366261:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14233:x1869117117258880:12345-0@lo:101:mount.lustre.0 Request processed in 121us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529341.366269:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782529341.366281:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643964e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117258880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529341.366299:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c640030600/0x72bfdc08f7eacc0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc11 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.366311:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c640030600/0x72bfdc08f7eacc0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacc11 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.366365:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117259008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529341.366398:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.366419:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529341.366566:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117259008 00000100:00100000:0.0:1782529341.366571:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117259008 00000100:00100000:0.0:1782529341.366592:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782529341.366598:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14233:x1869117117259008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782529341.366865:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14233:x1869117117259008:12345-0@lo:501:mount.lustre.0 Request processed in 266us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529341.366873:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782529341.367878:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117259008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529341.367931:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117259136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782529341.367996:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.368034:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529341.369252:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117259136 00000100:00100000:0.0:1782529341.369262:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117259136 00000100:00100000:0.0:1782529341.369323:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782529341.369333:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14233:x1869117117259136:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782529341.369683:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14233:x1869117117259136:12345-0@lo:503:mount.lustre.0 Request processed in 350us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529341.369692:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782529341.369724:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117259136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782529341.373230:0:14280:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14280:1869117117259264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529341.373331:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529341.373374:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117259264 00000100:00100000:2.0:1782529341.373380:0:14280:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645a2d180 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.373383:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117259264 00000100:00100000:3.0:1782529341.373438:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782529341.373448:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14280:x1869117117259264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782529341.373695:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14280:x1869117117259264:12345-0@lo:502:llog_process_th.0 Request processed in 248us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.373702:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782529341.373895:0:14280:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14280:1869117117259264:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1782529341.374039:0:14280:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1782529341.374054:0:14280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99c645aa19c0) 00000020:00000080:2.0:1782529341.374078:0:14280:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1782529341.374315:0:14280:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c67f8f1800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782529341.374320:0:14280:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c67f8f1800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782529341.374323:0:14280:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c67f8f1800 4 00010000:00080000:2.0:1782529341.374348:0:14280:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c680cfe000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1782529341.376235:0:14280:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1782529341.376366:0:14280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1782529341.376403:0:14280:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782529341.376417:0:14280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72bfdc08f7eacc1f 00000100:00080000:2.0:1782529341.376428:0:14280:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782529341.376434:0:14280:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99c680cfe000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1782529341.376474:0:14280:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67fae7480 x1869117117259392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782529341.376526:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117259392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782529341.376634:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529341.376713:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117259392 00000100:00100000:2.0:1782529341.376720:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117259392 00000100:00100000:2.0:1782529341.376749:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529341.376756:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3293:x1869117117259392:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782529341.376803:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3293:x1869117117259392:12345-0@lo:38:llog_process_th.0 Request processed in 45us (169us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782529341.376810:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529341.376874:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782529341.376881:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c680cfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782529341.376903:0:3293:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782529341.376907:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117259392:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1782529341.376934:0:14280:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782529341.382541:0:14280:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14280:1869117117259520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782529341.382632:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529341.382687:0:14280:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645a2d180 going to sleep for 11 seconds 00000100:00100000:1.0:1782529341.382826:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117259520 00000100:00100000:1.0:1782529341.382858:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117259520 00000100:00100000:1.0:1782529341.382906:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782529341.383038:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14280:x1869117117259520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782529341.383311:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14280:x1869117117259520:12345-0@lo:502:llog_process_th.0 Request processed in 396us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529341.383320:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782529341.383380:0:14280:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14280:1869117117259520:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782529341.383558:0:14280:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782529341.390878:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782529341.391019:0:14233:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782529341.391052:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640030600/0x72bfdc08f7eacc0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc11 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529341.391065:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c640030600/0x72bfdc08f7eacc0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc11 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782529341.391118:0:14233:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782529341.391122:0:14233:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529341.391123:0:14233:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529341.391124:0:14233:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529341.391126:0:14233:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529341.391127:0:14233:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529341.391128:0:14233:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529341.391130:0:14233:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529341.391132:0:14233:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529341.391133:0:14233:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782529341.391137:0:14233:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1782529341.391139:0:14233:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782529341.391140:0:14233:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529341.391141:0:14233:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529341.391142:0:14233:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529341.391143:0:14233:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529341.391149:0:14233:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529341.391150:0:14233:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529341.391151:0:14233:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529341.391151:0:14233:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529341.391152:0:14233:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782529341.391179:0:14233:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782529341.391200:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117259648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782529341.391269:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529341.391313:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645a2d300 going to sleep for 11 seconds 00000100:00100000:3.0:1782529341.392389:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117259648 00000100:00100000:3.0:1782529341.392401:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117259648 00000100:00100000:3.0:1782529341.392470:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782529341.394417:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14233:x1869117117259648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782529341.394461:0:14245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782529341.394477:0:14245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782529341.478771:0:14245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782529341.478792:0:14245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1782529341.480194:0:14267:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782529341.480202:0:14267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782529341.480228:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.480248:0:14267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 12 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.480258:0:14267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.482499:0:14267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 12 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529341.482519:0:14267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 12 pid: 14245 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529341.482536:0:14267:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14267:1869117117259776:0@lo:104: 00000100:00100000:0.0:1782529341.482603:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529341.482712:0:14267:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c681601f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782529341.483596:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117259776 00000100:00100000:1.0:1782529341.483606:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117259776 00000100:00100000:1.0:1782529341.483655:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782529341.483665:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:14267:x1869117117259776:12345-0@lo:104: 00010000:00010000:1.0:1782529341.483680:0:14234:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.483769:0:14234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782529341.483777:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:14267:x1869117117259776:12345-0@lo:104: Request processed in 114us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529341.483784:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782529341.483901:0:14267:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14267:1869117117259776:0@lo:104: 00010000:00010000:0.0:1782529341.483924:0:14267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.484069:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782529341.484076:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.484084:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7c00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529341.484088:0:14240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.484097:0:14240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529341.484115:0:14240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529341.484121:0:14240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782529341.484159:0:14240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.484166:0:14240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782529341.484193:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.484201:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacbee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacbf5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529341.484220:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529341.484222:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529341.484223:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529341.485490:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117259904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529341.485553:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529341.485660:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117259904 00000100:00100000:1.0:1782529341.485667:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117259904 00010000:00010000:1.0:1782529341.485697:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 13 pid: 14245 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.485747:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782529341.485755:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+13:3294:x1869117117259904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782529341.485768:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529341.485774:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 13 pid: 14245 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485784:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 13 pid: 14245 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485801:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c682044a00/0x72bfdc08f7eacbf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eacbee expref: 13 pid: 14245 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485818:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485826:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782529341.485896:0:14236:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005695645s 00010000:00010000:1.0:1782529341.485902:0:14236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485909:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485916:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485923:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485935:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529341.485939:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485948:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485973:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.485982:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529341.486014:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:3294:x1869117117259904:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529341.486022:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1782529341.486050:0:14267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.486058:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529341.486065:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030000/0x72bfdc08f7eacc26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529341.487240:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117259904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782529341.509477:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14233:x1869117117259648:12345-0@lo:253:mount.lustre.0 Request processed in 116990us (118200us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529341.509493:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782529341.509531:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14233:1869117117259648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782529341.509548:0:14233:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782529341.509552:0:14233:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782529341.509554:0:14233:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782529341.509555:0:14233:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529341.509556:0:14233:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529341.509557:0:14233:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529341.509558:0:14233:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529341.509559:0:14233:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782529341.509560:0:14233:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782529341.509562:0:14233:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529341.509563:0:14233:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782529341.509578:0:14233:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782529341.521729:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1782529341.522705:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782529341.523105:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1782529341.523287:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782529341.523567:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1782529341.523727:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1782529341.525256:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1782529341.525510:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1782529341.525777:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1782529341.527214:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1782529341.527680:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1782529341.527892:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1782529341.595354:0:14233:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1782529341.595865:0:14233:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1782529341.595967:0:14289:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1782529341.595972:0:14289:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1782529341.596520:0:14290:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1782529341.596681:0:14290:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782529341.601324:0:14290:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782529341.601416:0:14290:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782529341.601420:0:14290:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1782529341.603354:0:14233:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1782529341.603486:0:14233:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782529341.604218:0:14233:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782529341.604229:0:14233:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1782529341.604462:0:14233:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529341.606150:0:14233:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1782529341.606830:0:14233:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782529341.607061:0:14233:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1782529341.609442:0:14233:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1782529341.616671:0:14233:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1782529341.676132:0:14233:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782529341.676175:0:14233:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1b901c33988 00100000:10000000:3.0:1782529341.676185:0:14233:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1782529341.677226:0:14233:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782529341.677242:0:14233:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782529341.677274:0:14233:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1782529341.677292:0:14233:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1782529342.087963:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782529342.342900:0:14248:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782529342.342908:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff99c67f8f1800 from 6 10000000:01000000:1.0:1782529342.342913:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782529342.342971:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529342.342985:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529342.342996:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529342.343024:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117260032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529342.343102:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529342.343169:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782529342.344887:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117260032 00000100:00100000:0.0:1782529342.344900:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117260032 00000100:00100000:0.0:1782529342.344975:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782529342.344986:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14248:x1869117117260032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529342.345003:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529342.345024:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacc2d expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529342.345058:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529342.345070:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529342.345079:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031600, rc 0) 00000100:00100000:0.0:1782529342.345155:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14248:x1869117117260032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529342.345161:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782529342.345290:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117260032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529342.345309:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529342.345318:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529342.345383:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117260160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782529342.345422:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529342.345457:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782529342.345521:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117260160 00000100:00100000:3.0:1782529342.345527:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117260160 00000100:00100000:3.0:1782529342.345570:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782529342.345577:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14248:x1869117117260160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782529342.345592:0:14245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782529342.345608:0:14245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782529342.345611:0:14245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1782529342.345697:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14248:x1869117117260160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529342.345705:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782529342.345899:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117260160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782529342.345940:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782529342.345960:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529342.345969:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782529342.415300:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782529343.113249:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782529343.431641:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782529344.135971:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529345.159029:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782529345.636431:0:14533:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782529346.184387:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782529346.632272:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782529346.632278:0:12767:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782529346.632281:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782529346.632296:0:12767:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782529346.632298:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782529346.632301:0:12767:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782529346.632305:0:12767:0:(import.c:65:import_set_state_nolock()) ffff99c680cfe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782529346.632316:0:12767:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99c680cfe000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1782529346.632337:0:12767:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67f1d4000 x1869117117260416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782529346.632371:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117260416:0@lo:38:kworker.0 00000100:00100000:3.0:1782529346.632445:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529346.633683:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529346.633705:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117260288:0@lo:400:kworker.0 00000100:00100000:0.0:1782529346.633763:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529346.634045:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117260288 00000100:00100000:3.0:1782529346.634054:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117260288 00000100:00100000:3.0:1782529346.634106:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782529346.634115:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:3294:x1869117117260288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529346.634175:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:3294:x1869117117260288:12345-0@lo:400:kworker.0 Request processed in 60us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529346.634182:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782529346.634232:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117260288:0@lo:400:kworker.0 00000100:00100000:2.0:1782529346.635229:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117260416 00000100:00100000:2.0:1782529346.635238:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117260416 00000100:00100000:2.0:1782529346.635302:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529346.635309:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3293:x1869117117260416:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1782529346.635334:0:14253:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:2.0:1782529346.635382:0:14253:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72bfdc08f7eacc3b 00000004:00100000:2.0:1782529346.635399:0:14253:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782529346.635538:0:14253:0:(import.c:65:import_set_state_nolock()) ffff99c64856a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782529346.635615:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869117117260416:12345-0@lo:38:kworker.0 Request processed in 305us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529346.635622:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782529346.635686:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99c67f1d4000 x1869117117260416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782529356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782529346.635702:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782529346.635710:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782529346.635715:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782529346.635718:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c680cfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782529346.635723:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869117117260416:0@lo:38:kworker.0 00010000:00010000:0.0:1782529347.210978:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529348.231033:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782529348.385355:0:14683:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9f43def0 20000000:00000080:1.0:1782529348.385372:0:14683:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99c67a23a400 uarg=0000000000000000 20000000:01000000:1.0:1782529348.385406:0:14683:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1782529348.385412:0:14683:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1782529348.385417:0:14683:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1782529348.386274:0:14684:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1782529348.386724:0:14683:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782529348.394206:0:14683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782529348.394312:0:14683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.394333:0:14683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.394341:0:14683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.394388:0:14683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.394490:0:14683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 11 pid: 14244 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529348.394578:0:14683:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14683:1869117117260544:0@lo:104: 00000100:00100000:0.0:1782529348.394728:0:14683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529348.394815:0:14683:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67fb64240 going to sleep for 11 seconds 00000100:00100000:2.0:1782529348.397625:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117260544 00000100:00100000:2.0:1782529348.397710:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117260544 00000100:00100000:2.0:1782529348.397802:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529348.397813:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:14683:x1869117117260544:12345-0@lo:104: 00010000:00010000:2.0:1782529348.397855:0:14235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529348.397970:0:14235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529348.397977:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:14683:x1869117117260544:12345-0@lo:104: Request processed in 167us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529348.397984:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1782529348.398047:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782529348.398055:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529348.398063:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6a00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:3.0:1782529348.398068:0:14240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529348.398075:0:14240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782529348.398083:0:14240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529348.398088:0:14240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782529348.398126:0:14240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529348.398133:0:14240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782529348.398155:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529348.398162:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c6587c6a00/0x72bfdc08f7eacbfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc03 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529348.398178:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529348.398180:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529348.398182:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529348.398207:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3296:1869117117260672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782529348.398248:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529348.398409:0:14683:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14683:1869117117260544:0@lo:104: 00010000:00010000:0.0:1782529348.398434:0:14683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529348.398485:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117260672 00000100:00100000:0.0:1782529348.398489:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117260672 00010000:00010000:0.0:1782529348.398521:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 12 pid: 14244 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529348.398549:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782529348.398557:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:3296:x1869117117260672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782529348.398568:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529348.398573:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 12 pid: 14244 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398584:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 12 pid: 14244 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398598:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640030a00/0x72bfdc08f7eacc03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eacbfc expref: 12 pid: 14244 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398611:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398620:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398634:0:14236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398654:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398667:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398673:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398679:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529348.398683:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398690:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398704:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398713:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529348.398745:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:3296:x1869117117260672:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529348.398751:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1782529348.398773:0:14683:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398780:0:14683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529348.398786:0:14683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640031000/0x72bfdc08f7eacc42 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529348.399657:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3296:1869117117260672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782529349.257602:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782529349.705310:0:14248:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782529349.705317:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c67f8f1800 from 10 10000000:01000000:1.0:1782529349.705322:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529349.705368:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529349.705381:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529349.705393:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529349.705419:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117260800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529349.705490:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529349.705543:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f2480 going to sleep for 11 seconds 00000100:00100000:1.0:1782529349.705567:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117260800 00000100:00100000:1.0:1782529349.705573:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117260800 00000100:00100000:1.0:1782529349.705625:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782529349.705635:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+11:14248:x1869117117260800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529349.705650:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529349.705666:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacc49 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529349.705711:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 12 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529349.705721:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 12 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529349.705730:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7a00, rc 0) 00000100:00100000:1.0:1782529349.705771:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14248:x1869117117260800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529349.705779:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782529349.705826:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117260800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529349.705864:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529349.705874:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529349.705934:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117260928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529349.705960:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529349.705990:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1782529349.706398:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117260928 00000100:00100000:2.0:1782529349.706404:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117260928 00000100:00100000:2.0:1782529349.706698:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782529349.706707:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14248:x1869117117260928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782529349.706996:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14248:x1869117117260928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529349.707004:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782529349.707070:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117260928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529349.707102:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117261056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529349.707138:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529349.707167:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6482f2480 going to sleep for 11 seconds 00000100:00100000:3.0:1782529349.707265:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117261056 00000100:00100000:3.0:1782529349.707270:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117261056 00000100:00100000:3.0:1782529349.707305:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782529349.707313:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14248:x1869117117261056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529349.707471:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14248:x1869117117261056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529349.707479:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782529349.707624:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117261056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782529349.710751:0:14745:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782529349.713370:0:14248:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782529349.713404:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782529349.713416:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529349.713429:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529350.280601:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529351.304442:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782529351.752169:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782529351.752178:0:12767:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782529351.752181:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782529351.752184:0:12767:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782529351.752241:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117261184:0@lo:400:kworker.0 00000100:00100000:1.0:1782529351.752341:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529351.752700:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117261312:0@lo:400:kworker.0 00000100:00100000:1.0:1782529351.752744:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529351.752786:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117261184 00000100:00100000:1.0:1782529351.752795:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117261184 00000100:00100000:1.0:1782529351.752900:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782529351.752911:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:3297:x1869117117261184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529351.753046:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:3297:x1869117117261184:12345-0@lo:400:kworker.0 Request processed in 137us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529351.753054:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782529351.753131:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117261184:0@lo:400:kworker.0 00000100:00100000:2.0:1782529351.753313:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117261312 00000100:00100000:2.0:1782529351.753331:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117261312 00000100:00100000:2.0:1782529351.753372:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529351.753381:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117261312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529351.753457:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117261312:12345-0@lo:400:kworker.0 Request processed in 77us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529351.753465:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782529351.753817:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99c678318700 x1869117117261312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529351.753859:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117261312:0@lo:400:kworker.0 00000100:00100000:1.0:1782529351.756749:0:3293:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782529341/real 1782529341] req@ffff99c67831b480 x1869117117257728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782529351 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529351.756807:0:3293:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99c67831b480 x1869117117257728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782529351 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529351.756819:0:3293:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782529341/real 1782529341] req@ffff99c678319f80 x1869117117257600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782529351 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529351.756878:0:3293:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99c678319f80 x1869117117257600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782529351 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782529351.756903:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6783b9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782529351.756927:0:3293:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782529351.756931:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117257728:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1782529351.756937:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6772d3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782529351.756942:0:3293:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782529351.756945:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117257600:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1782529351.756990:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782529351.756996:0:12767:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1782529351.756999:0:12767:0:(import.c:65:import_set_state_nolock()) ffff99c6772d3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782529351.757004:0:12767:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:1.0:1782529351.757009:0:12767:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782529351.757018:0:12767:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99c6772d3800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529351.757069:0:12767:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c678319f80 x1869117117261440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782529351.757089:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782529351.757093:0:12767:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782529351.757101:0:12767:0:(import.c:65:import_set_state_nolock()) ffff99c6783b9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782529351.757105:0:12767:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:1.0:1782529351.757108:0:12767:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782529351.757112:0:12767:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99c6783b9000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529351.757126:0:12767:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67831b480 x1869117117261568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782529351.757266:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117261440:0@lo:8:kworker.0 00000400:00000100:1.0:1782529351.757329:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869117117261440 offset 0 length 520: 4 00000100:00100000:1.0:1782529351.757375:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117261568:0@lo:8:kworker.0 00000400:00000100:1.0:1782529351.757400:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869117117261568 offset 0 length 520: 4 00010000:00010000:1.0:1782529352.327074:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782529352.553641:0:14884:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782529352.553644:0:14884:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1782529352.553762:0:14884:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99c645ab2000 00000020:01000004:3.0:1782529352.553780:0:14884:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1782529352.553793:0:14884:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782529352.553809:0:14884:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99c645a44d40) 00000020:00000080:3.0:1782529352.553824:0:14884:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782529352.572659:0:14884:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782529352.573031:0:14884:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782529352.573950:0:14884:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782529352.574187:0:14884:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1782529352.574536:0:14884:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782529352.575029:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1782529352.575114:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1782529352.575356:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1782529352.578284:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 388: rc = 0 00100000:10000000:3.0:1782529352.578616:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 388: rc = 0 00100000:10000000:3.0:1782529352.578921:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 388: rc = 0 00100000:10000000:3.0:1782529352.579178:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 388: rc = 0 00100000:10000000:3.0:1782529352.579416:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 388: rc = 0 00100000:10000000:3.0:1782529352.579630:0:14884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 388: rc = 0 00000020:00000080:3.0:1782529352.581661:0:14884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782529352.581676:0:14884:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782529352.581688:0:14884:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bfdc08f7eacc5e 00000020:01000004:3.0:1782529352.581699:0:14884:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782529352.581721:0:14884:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782529352.581724:0:14884:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782529352.581729:0:14884:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782529352.581733:0:14884:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782529352.581752:0:14884:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99c679f94d40) 00000020:00000080:3.0:1782529352.581772:0:14884:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1782529352.587134:0:14884:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782529352.587331:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782529352.587338:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782529352.590375:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782529352.590392:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782529352.590931:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782529352.590938:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782529352.595639:0:14884:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782529352.597507:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782529352.597523:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1782529352.598293:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1782529352.598303:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782529352.640274:0:14884:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782529352.640781:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782529352.640792:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782529352.645007:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782529352.645028:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782529352.651114:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782529352.651132:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1782529352.659527:0:14884:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782529352.659749:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1782529352.659756:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782529352.660496:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782529352.660505:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1782529352.716075:0:14884:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782529352.716267:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1782529352.716274:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1782529352.719912:0:14884:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1782529352.721162:0:14884:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782529352.721703:0:14884:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782529352.721729:0:14884:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1782529352.721735:0:14884:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782529352.737209:0:14884:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782529352.737254:0:14884:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1782529352.737258:0:14884:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782529352.737260:0:14884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782529352.737261:0:14884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529352.737262:0:14884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529352.737263:0:14884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529352.737264:0:14884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529352.737266:0:14884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782529352.737267:0:14884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529352.737273:0:14884:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782529352.737278:0:14884:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1782529352.737279:0:14884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782529352.737281:0:14884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782529352.737281:0:14884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529352.737282:0:14884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529352.737283:0:14884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529352.737284:0:14884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529352.737285:0:14884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782529352.737285:0:14884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529352.737286:0:14884:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782529352.737311:0:14884:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782529352.737333:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117261696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782529352.737407:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529352.737466:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c65411dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.737558:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117261696 00000100:00100000:1.0:1782529352.737565:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117261696 00000100:00100000:1.0:1782529352.737621:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782529352.737631:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14884:x1869117117261696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782529352.737677:0:14246:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782529352.737681:0:14246:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1782529352.737685:0:14246:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1782529352.753221:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14884:x1869117117261696:12345-0@lo:253:mount.lustre.0 Request processed in 15582us (15804us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529352.753239:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529352.753353:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117261696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782529352.753370:0:14884:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782529352.753374:0:14884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782529352.753375:0:14884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782529352.753377:0:14884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529352.753378:0:14884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529352.753380:0:14884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529352.753381:0:14884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529352.753383:0:14884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782529352.753385:0:14884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529352.753387:0:14884:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782529352.753411:0:14884:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99c645ab2000 from lustre-OST0000 10000000:01000000:2.0:1782529352.753439:0:14884:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782529352.753442:0:14884:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782529352.753449:0:14884:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99c67f363380 local copy 00010000:00010000:2.0:1782529352.753460:0:14884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529352.753706:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117261824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782529352.753751:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529352.753796:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c65411d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.754973:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117261824 00000100:00100000:1.0:1782529352.754984:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117261824 00000100:00100000:1.0:1782529352.755045:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782529352.755067:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14884:x1869117117261824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529352.755581:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14884:x1869117117261824:12345-0@lo:501:mount.lustre.0 Request processed in 515us (1827us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782529352.755591:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782529352.756200:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117261824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782529352.756229:0:14884:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782529352.756436:0:14884:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782529352.756446:0:14884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.756457:0:14884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529352.756548:0:14884:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99c645ab2000 10000000:01000000:3.0:1782529352.756554:0:14884:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782529352.756558:0:14884:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99c67f363380 10000000:01000000:3.0:1782529352.756561:0:14884:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782529352.756563:0:14884:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff99c67f363380 from 1 10000000:01000000:3.0:1782529352.756566:0:14884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782529352.756599:0:14884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045400/0x72bfdc08f7eacc6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.756608:0:14884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682045400/0x72bfdc08f7eacc6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.756618:0:14884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682045400/0x72bfdc08f7eacc6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529352.756636:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117261952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782529352.756680:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529352.756784:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646391540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.756853:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117261952 00000100:00100000:1.0:1782529352.756867:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117261952 00000100:00100000:1.0:1782529352.756950:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782529352.756959:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+12:14884:x1869117117261952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529352.756970:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529352.756984:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c6587c7600/0x72bfdc08f7eacc73 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacc6c expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.757005:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c6587c7600/0x72bfdc08f7eacc73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc6c expref: 13 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.757014:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c6587c7600/0x72bfdc08f7eacc73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc6c expref: 13 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.757022:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7600, rc 0) 00000100:00100000:1.0:1782529352.757105:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+13:14884:x1869117117261952:12345-0@lo:101:mount.lustre.0 Request processed in 147us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.757112:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782529352.757166:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117261952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782529352.757178:0:14884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682045400/0x72bfdc08f7eacc6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc73 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.757187:0:14884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682045400/0x72bfdc08f7eacc6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacc73 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529352.757212:0:14884:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782529352.757275:0:14884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045400/0x72bfdc08f7eacc6c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc73 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.757282:0:14884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682045400/0x72bfdc08f7eacc6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc73 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529352.757289:0:14884:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782529352.757293:0:14884:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782529352.757298:0:14884:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782529352.757300:0:14884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782529352.757313:0:14884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eacc7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.757320:0:14884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eacc7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.757327:0:14884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eacc7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529352.757340:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782529352.757365:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529352.757516:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646391540 going to sleep for 11 seconds 00000100:00100000:2.0:1782529352.757637:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117262080 00000100:00100000:2.0:1782529352.757642:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117262080 00000100:00100000:2.0:1782529352.757665:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782529352.757671:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+13:14884:x1869117117262080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782529352.757679:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529352.757688:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d01e00/0x72bfdc08f7eacc81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacc7a expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.757701:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d01e00/0x72bfdc08f7eacc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc7a expref: 14 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.757709:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d01e00/0x72bfdc08f7eacc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc7a expref: 14 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.757715:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01e00, rc 0) 00000100:00100000:2.0:1782529352.757755:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262080:12345-0@lo:101:mount.lustre.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.757760:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782529352.757869:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782529352.757881:0:14884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eacc7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc81 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.757888:0:14884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eacc7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacc81 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782529352.758570:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1782529352.759384:0:14884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529352.759624:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1782529352.759678:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1782529352.759712:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1782529352.759754:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1782529352.759791:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1782529352.759822:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1782529352.759959:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1782529352.759967:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1782529352.760035:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529352.760097:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529352.760119:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646391240 going to sleep for 11 seconds 00000100:00100000:2.0:1782529352.760304:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117262208 00000100:00100000:2.0:1782529352.760312:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117262208 00000100:00100000:2.0:1782529352.760350:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782529352.760359:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782529352.760699:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262208:12345-0@lo:501:mount.lustre.0 Request processed in 340us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.760707:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782529352.761074:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529352.761110:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782529352.761154:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529352.761223:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646391240 going to sleep for 11 seconds 00000100:00100000:2.0:1782529352.761255:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117262336 00000100:00100000:2.0:1782529352.761267:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117262336 00000100:00100000:2.0:1782529352.761340:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782529352.761348:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782529352.761667:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262336:12345-0@lo:503:mount.lustre.0 Request processed in 318us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.761673:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782529352.761742:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262336:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782529352.762293:0:14884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782529352.762351:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782529352.762391:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529352.762682:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6516fb780 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.762771:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117262464 00000100:00100000:1.0:1782529352.762777:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117262464 00000100:00100000:1.0:1782529352.762808:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782529352.762816:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782529352.763074:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262464:12345-0@lo:502:mount.lustre.0 Request processed in 258us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.763088:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782529352.763217:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782529352.763465:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1782529352.763628:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1782529352.763674:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1782529352.763724:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1782529352.763761:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1782529352.763795:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1782529352.763913:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1782529352.763951:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1782529352.763983:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1782529352.764030:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1782529352.764066:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1782529352.764124:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1782529352.764159:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782529352.764208:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529352.764292:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646391240 going to sleep for 11 seconds 00000100:00100000:2.0:1782529352.764443:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117262592 00000100:00100000:2.0:1782529352.764450:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117262592 00000100:00100000:1.0:1782529352.764570:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782529352.764579:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782529352.764752:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262592:12345-0@lo:502:mount.lustre.0 Request processed in 173us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.764759:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782529352.764890:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782529352.764959:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1782529352.764969:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1782529352.765809:0:14898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782529352.765817:0:14898:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1782529352.765823:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529352.765825:0:14898:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1782529352.765865:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782529352.765883:0:14898:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99c679f919c0) 00000020:00000080:3.0:1782529352.765903:0:14898:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782529352.765909:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782529352.765975:0:14898:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c645ab2000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1782529352.765982:0:14898:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782529352.765989:0:14898:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bfdc08f7eacc8f 00010000:00010000:3.0:1782529352.769779:0:14898:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1782529352.770220:0:14898:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1782529352.771559:0:14898:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1782529352.772316:0:14898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1782529352.772332:0:14898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529352.772338:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529352.772341:0:14898:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1782529352.772345:0:14898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782529352.772347:0:14898:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1782529352.772349:0:14898:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782529352.772350:0:14898:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782529352.772352:0:14898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782529352.772354:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529352.772355:0:14898:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782529352.772358:0:14898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529352.772360:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529352.772361:0:14898:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782529352.772364:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782529352.772366:0:14898:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782529352.772369:0:14898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529352.772370:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529352.772372:0:14898:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1782529352.772374:0:14898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782529352.772376:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529352.772377:0:14898:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782529352.772380:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1782529352.772423:0:14898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782529352.772426:0:14898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782529352.772427:0:14898:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782529352.772430:0:14898:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1782529352.772774:0:14884:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1782529352.772800:0:14884:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782529352.772818:0:14884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eacc7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc81 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529352.772853:0:14884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682045000/0x72bfdc08f7eacc7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc81 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529352.772879:0:14884:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c645ab2000 from 1 10000000:01000000:0.0:1782529352.772882:0:14884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782529352.772916:0:14884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529352.772925:0:14884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529352.772936:0:14884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529352.772959:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782529352.773034:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529352.777922:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16900 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.778135:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117262720 00000100:00100000:1.0:1782529352.778144:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117262720 00000100:00100000:1.0:1782529352.778189:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782529352.778199:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+14:14884:x1869117117262720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529352.778215:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529352.778233:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacc96 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.778260:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 15 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.778271:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 15 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.778280:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6400, rc 0) 00000100:00100000:1.0:1782529352.778350:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117262720:12345-0@lo:101:mount.lustre.0 Request processed in 152us (5315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.778357:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782529352.778457:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782529352.778475:0:14884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529352.778496:0:14884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782529352.779067:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1782529352.779551:0:14884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782529352.779757:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1782529352.779797:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1782529352.779921:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1782529352.779930:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1782529352.780009:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782529352.780074:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529352.780120:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16900 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.780320:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117262848 00000100:00100000:1.0:1782529352.780329:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117262848 00000100:00100000:1.0:1782529352.780362:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782529352.780377:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117262848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529352.780604:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117262848:12345-0@lo:501:mount.lustre.0 Request processed in 228us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.780613:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782529352.780974:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782529352.781010:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782529352.781054:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529352.781084:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16900 going to sleep for 11 seconds 00000100:00100000:2.0:1782529352.781165:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117262976 00000100:00100000:2.0:1782529352.781171:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117262976 00000100:00100000:2.0:1782529352.781197:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782529352.781204:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117262976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782529352.781355:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117262976:12345-0@lo:503:mount.lustre.0 Request processed in 150us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.781362:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782529352.782630:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117262976:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782529352.783352:0:14884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782529352.783426:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782529352.783568:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529352.783618:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6412ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.784684:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117263104 00000100:00100000:1.0:1782529352.784694:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117263104 00000100:00100000:1.0:1782529352.784734:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782529352.784744:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117263104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782529352.785031:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117263104:12345-0@lo:502:mount.lustre.0 Request processed in 286us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.785038:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782529352.785646:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782529352.785949:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1782529352.786000:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1782529352.786067:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1782529352.786105:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1782529352.786137:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1782529352.786185:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1782529352.786232:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1782529352.786264:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1782529352.786300:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782529352.786359:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529352.786403:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16900 going to sleep for 11 seconds 00000100:00100000:2.0:1782529352.787052:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117263232 00000100:00100000:2.0:1782529352.787612:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117263232 00000100:00100000:2.0:1782529352.787669:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782529352.787679:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117263232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782529352.787931:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117263232:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.787939:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782529352.789613:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782529352.789787:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1782529352.789803:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1782529352.791428:0:14902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529352.791439:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529352.791442:0:14902:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782529352.791450:0:14902:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c645ab2000 00000020:00000080:0.0:1782529352.791452:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782529352.791459:0:14902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529352.791461:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529352.791463:0:14902:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782529352.791465:0:14902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529352.791468:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529352.791469:0:14902:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782529352.791472:0:14902:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c645ab2000 00000020:00000080:0.0:1782529352.791474:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782529352.792006:0:14902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529352.792010:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529352.792012:0:14902:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782529352.792016:0:14902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529352.792019:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529352.792020:0:14902:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782529352.792024:0:14902:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99c645ab2000 00000020:00000080:0.0:1782529352.792026:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782529352.792069:0:14902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529352.792072:0:14902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529352.792074:0:14902:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782529352.792083:0:14902:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1782529352.792656:0:14884:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782529352.792681:0:14884:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782529352.792705:0:14884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.792718:0:14884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529352.792763:0:14884:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782529352.792766:0:14884:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99c645ab2000 10000000:01000000:1.0:1782529352.792769:0:14884:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99c645ab2000 10000000:01000000:1.0:1782529352.792773:0:14884:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782529352.792779:0:14884:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c645ab2000 from 1 10000000:01000000:1.0:1782529352.792782:0:14884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782529352.792817:0:14884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7800/0x72bfdc08f7eacca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.792827:0:14884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c7800/0x72bfdc08f7eacca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.793062:0:14884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c7800/0x72bfdc08f7eacca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529352.793092:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782529352.793162:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529352.793206:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c678332540 going to sleep for 11 seconds 00000100:00100000:3.0:1782529352.793569:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117263360 00000100:00100000:3.0:1782529352.793576:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117263360 00000100:00100000:3.0:1782529352.793612:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782529352.793620:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117263360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782529352.793634:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529352.793645:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682045600/0x72bfdc08f7eaccab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacca4 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.793681:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682045600/0x72bfdc08f7eaccab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacca4 expref: 16 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.793691:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682045600/0x72bfdc08f7eaccab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacca4 expref: 16 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529352.793701:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682045600, rc 0) 00000100:00100000:3.0:1782529352.793751:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263360:12345-0@lo:101:mount.lustre.0 Request processed in 131us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529352.793759:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782529352.794995:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782529352.795016:0:14884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c7800/0x72bfdc08f7eacca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccab expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529352.795027:0:14884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7800/0x72bfdc08f7eacca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaccab expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782529352.797130:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1782529352.798389:0:14884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782529352.799188:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1782529352.799233:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1782529352.799262:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1782529352.799302:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1782529352.799334:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1782529352.799376:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1782529352.799406:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1782529352.799434:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1782529352.799473:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1782529352.802900:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1782529352.802942:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1782529352.803014:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1782529352.803045:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1782529352.803080:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1782529352.803126:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1782529352.803161:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1782529352.803216:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1782529352.803266:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1782529352.803301:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1782529352.803334:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1782529352.803391:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1782529352.803436:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1782529352.803464:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1782529352.807770:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1782529352.808544:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1782529352.808633:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1782529352.809117:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1782529352.809491:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1782529352.809590:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1782529352.809599:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1782529352.809749:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782529352.809823:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529352.809917:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16900 going to sleep for 11 seconds 00000100:00100000:2.0:1782529352.809941:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117263488 00000100:00100000:2.0:1782529352.809950:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117263488 00000100:00100000:2.0:1782529352.810131:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782529352.810142:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782529352.810426:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263488:12345-0@lo:501:mount.lustre.0 Request processed in 285us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.810441:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782529352.810477:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782529352.810512:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782529352.810556:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529352.810580:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645b16900 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.810609:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117263616 00000100:00100000:1.0:1782529352.810615:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117263616 00000100:00100000:1.0:1782529352.810660:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782529352.810667:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782529352.810905:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263616:12345-0@lo:503:mount.lustre.0 Request processed in 237us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.810913:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782529352.810918:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782529352.811482:0:14884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782529352.811547:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782529352.811591:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529352.811645:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c653a1e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.811654:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117263744 00000100:00100000:1.0:1782529352.811661:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117263744 00000100:00100000:1.0:1782529352.811698:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782529352.811705:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782529352.812000:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263744:12345-0@lo:502:mount.lustre.0 Request processed in 294us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.812009:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782529352.812030:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782529352.812507:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1782529352.812552:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1782529352.812586:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1782529352.812719:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1782529352.812759:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1782529352.812817:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1782529352.813003:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1782529352.813049:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1782529352.813105:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782529352.813141:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1782529352.813175:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1782529352.813222:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1782529352.813270:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1782529352.813302:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1782529352.813349:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1782529352.813385:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1782529352.813421:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1782529352.813493:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1782529352.813532:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1782529352.813586:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1782529352.813683:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1782529352.813715:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1782529352.813744:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1782529352.813916:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1782529352.814003:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1782529352.814080:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1782529352.814207:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1782529352.814314:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1782529352.814404:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1782529352.814502:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1782529352.814538:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1782529352.814577:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1782529352.814619:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1782529352.814663:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1782529352.814692:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1782529352.814733:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1782529352.814762:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1782529352.814791:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1782529352.814854:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1782529352.814922:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1782529352.814969:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782529352.815040:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529352.815090:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c678332900 going to sleep for 11 seconds 00000100:00100000:0.0:1782529352.815091:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117263872 00000100:00100000:0.0:1782529352.815100:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117263872 00000100:00100000:0.0:1782529352.815164:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782529352.815174:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c65051a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782529352.815384:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c65051a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117263872:12345-0@lo:502:mount.lustre.0 Request processed in 212us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529352.815393:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782529352.816774:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117263872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782529352.816999:0:14884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1782529352.817032:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1782529352.819445:0:14906:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1782529352.819465:0:14906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99c680cf4d40) 00000020:00000080:0.0:1782529352.819489:0:14906:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1782529352.819691:0:14906:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c645ab2000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782529352.819695:0:14906:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c645ab2000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782529352.819699:0:14906:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c645ab2000 3 00010000:00080000:0.0:1782529352.819784:0:14906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c650564000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1782529352.822590:0:14906:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1782529352.822766:0:14906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782529352.822806:0:14906:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782529352.825587:0:14906:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72bfdc08f7eaccb9 00000100:00080000:1.0:1782529352.825605:0:14906:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782529352.825611:0:14906:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99c650564000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1782529352.825651:0:14906:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67831aa00 x1869117117264000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782529352.825685:0:14906:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782529352.825743:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3293:1869117117264000:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782529352.825820:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529352.825991:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117264000 00000100:00100000:1.0:1782529352.825998:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117264000 00000100:00100000:1.0:1782529352.826031:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529352.826040:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3293:x1869117117264000:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782529352.826066:0:14253:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:1.0:1782529352.826098:0:14253:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72bfdc08f7eaccc0 00000004:00100000:1.0:1782529352.826113:0:14253:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782529352.826143:0:14253:0:(import.c:65:import_set_state_nolock()) ffff99c67f345800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529352.826200:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869117117264000:12345-0@lo:38:llog_process_th.0 Request processed in 160us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.826210:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782529352.826236:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99c67831aa00 x1869117117264000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782529362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529352.826248:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782529352.826255:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1782529352.826262:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782529352.826267:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782529352.826269:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c650564000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782529352.826276:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3293:1869117117264000:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1782529352.829345:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782529352.829356:0:12767:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782529352.829360:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782529352.829363:0:12767:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782529352.829471:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117264128:0@lo:400:kworker.0 00000100:00100000:2.0:1782529352.829541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529352.829587:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117264128 00000100:00100000:2.0:1782529352.829594:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117264128 00000100:00100000:2.0:1782529352.829638:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529352.829648:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117264128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529352.829709:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117264128:12345-0@lo:400:kworker.0 Request processed in 63us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.829716:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782529352.829790:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99c67fae5180 x1869117117264128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529352.829874:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117264128:0@lo:400:kworker.0 00000040:00080000:1.0:1782529352.830024:0:14906:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1782529352.830521:0:14884:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1782529352.830549:0:14884:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782529352.830571:0:14884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7800/0x72bfdc08f7eacca4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccab expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529352.830583:0:14884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c7800/0x72bfdc08f7eacca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccab expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782529352.830634:0:14884:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782529352.830637:0:14884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782529352.830638:0:14884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782529352.830639:0:14884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782529352.830640:0:14884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782529352.830641:0:14884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782529352.830643:0:14884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782529352.830645:0:14884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782529352.830646:0:14884:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782529352.830651:0:14884:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1782529352.830654:0:14884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782529352.830655:0:14884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782529352.830657:0:14884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782529352.830658:0:14884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782529352.830659:0:14884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782529352.830661:0:14884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782529352.830662:0:14884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782529352.830663:0:14884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782529352.830664:0:14884:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782529352.830684:0:14884:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782529352.830700:0:14884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643965180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117264256:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782529352.830744:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529352.830780:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117264256 00000100:00100000:0.0:1782529352.830782:0:14884:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c653a1ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529352.830786:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117264256 00000100:00100000:1.0:1782529352.830829:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782529352.830852:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650519050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14884:x1869117117264256:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782529352.831182:0:14245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782529352.831196:0:14245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782529352.886680:0:14245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782529352.886753:0:14245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1782529352.889798:0:14267:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782529352.889808:0:14267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782529352.890021:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.890041:0:14267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 16 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.890050:0:14267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.890091:0:14267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 16 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529352.890105:0:14267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 16 pid: 14244 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529352.890120:0:14267:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14267:1869117117264384:0@lo:104: 00000100:00100000:1.0:1782529352.890186:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529352.890230:0:14267:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c678332900 going to sleep for 11 seconds 00000100:00100000:2.0:1782529352.890347:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117264384 00000100:00100000:2.0:1782529352.890355:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117264384 00000100:00100000:2.0:1782529352.890420:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529352.890429:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:14267:x1869117117264384:12345-0@lo:104: 00010000:00010000:2.0:1782529352.890443:0:14234:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.890514:0:14234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529352.890520:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:14267:x1869117117264384:12345-0@lo:104: Request processed in 93us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.890528:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1782529352.890562:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529352.890568:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.890576:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7e00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529352.890580:0:14239:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.890589:0:14239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529352.890595:0:14239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529352.890601:0:14239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782529352.890627:0:14239:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.890634:0:14239:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529352.890654:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.890661:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c6587c7e00/0x72bfdc08f7eacc2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc34 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.890676:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529352.890678:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529352.890680:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529352.890700:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3296:1869117117264512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529352.890727:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529352.890775:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117264512 00000100:00100000:2.0:1782529352.890779:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117264512 00010000:00010000:2.0:1782529352.890795:0:14238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 17 pid: 14244 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529352.890815:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529352.890821:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:3296:x1869117117264512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529352.891029:0:14267:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14267:1869117117264384:0@lo:104: 00010000:00010000:0.0:1782529352.891051:0:14267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891262:0:14238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529352.891270:0:14238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 17 pid: 14244 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891281:0:14238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 17 pid: 14244 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891294:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640031600/0x72bfdc08f7eacc34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eacc2d expref: 17 pid: 14244 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891307:0:14238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891316:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782529352.891330:0:14238:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005695645s 00010000:00010000:2.0:1782529352.891334:0:14238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891341:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891348:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891362:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891367:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529352.891371:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.891378:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529352.891799:0:14267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529352.891808:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.892094:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.892103:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c6587c7c00/0x72bfdc08f7eaccc7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529352.892118:0:14238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529352.892175:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:3296:x1869117117264512:12345-0@lo:103:ldlm_bl.0 Request processed in 1353us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529352.892183:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782529352.892258:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3296:1869117117264512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529352.898458:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650519050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14884:x1869117117264256:12345-0@lo:253:mount.lustre.0 Request processed in 67597us (67703us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529352.898484:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782529352.898691:0:14884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643965180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14884:1869117117264256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782529352.898707:0:14884:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782529352.898710:0:14884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782529352.898712:0:14884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782529352.898713:0:14884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529352.898715:0:14884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529352.898716:0:14884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529352.898717:0:14884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529352.898719:0:14884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782529352.898721:0:14884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529352.898736:0:14884:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782529352.898754:0:14884:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782529352.906586:0:14884:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529352.906760:0:14884:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782529352.906992:0:14884:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529352.907145:0:14884:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782529352.907288:0:14884:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529352.907479:0:14884:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1782529352.908584:0:14884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1782529352.971046:0:14884:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1782529352.971053:0:14884:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1782529352.971088:0:14884:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782529352.971151:0:14884:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782529352.971168:0:14884:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782529352.971194:0:14884:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1782529353.351252:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782529353.672059:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1782529354.184020:0:14248:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782529354.184027:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff99c67f8f1800 from 7 10000000:01000000:2.0:1782529354.184031:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782529354.184076:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529354.184088:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529354.184099:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529354.184125:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117264640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782529354.184194:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529354.184237:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c644f5eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529354.184426:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117264640 00000100:00100000:1.0:1782529354.184433:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117264640 00000100:00100000:1.0:1782529354.184473:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782529354.184485:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+15:14248:x1869117117264640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529354.184497:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529354.184507:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaccce expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529354.184531:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 16 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529354.184541:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 16 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529354.184550:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c7200, rc 0) 00000100:00100000:1.0:1782529354.184589:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14248:x1869117117264640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529354.184595:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782529354.184630:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117264640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529354.184640:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529354.184647:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529354.184682:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117264768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782529354.184702:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529354.184712:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c678332480 going to sleep for 11 seconds 00000100:00100000:1.0:1782529354.184722:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117264768 00000100:00100000:1.0:1782529354.184724:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117264768 00000100:00100000:1.0:1782529354.184737:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782529354.184746:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14248:x1869117117264768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782529354.184756:0:14245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782529354.184768:0:14245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782529354.184770:0:14245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1782529354.184818:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14248:x1869117117264768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 72us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529354.184823:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782529354.184879:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117264768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782529354.184928:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782529354.184934:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529354.184939:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529354.377388:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529355.400302:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529356.423491:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529357.447000:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782529357.895064:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782529357.895070:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782529357.895073:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782529357.895076:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782529357.895211:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117265024:0@lo:400:kworker.0 00000100:00100000:1.0:1782529357.895281:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529357.895338:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782529357.895344:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117265152:0@lo:400:kworker.0 00000100:00100000:1.0:1782529357.895370:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529357.895414:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117265024 00000100:00100000:1.0:1782529357.895421:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117265024 00000100:00100000:1.0:1782529357.895459:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117265152 00000100:00100000:1.0:1782529357.895462:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117265152 00000100:00100000:1.0:1782529357.895484:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529357.895492:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117265024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529357.895541:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117265024:12345-0@lo:400:kworker.0 Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529357.895548:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529357.895564:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529357.895569:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117265152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529357.895594:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117265152:12345-0@lo:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529357.895599:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782529357.895629:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c67831a680 x1869117117265152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529357.895641:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117265152:0@lo:400:kworker.0 00010000:00080000:1.0:1782529357.895649:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c678319880 x1869117117265024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529357.895656:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117265024:0@lo:400:kworker.0 00000100:00100000:2.0:1782529357.895823:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117264896:0@lo:400:kworker.0 00000100:00100000:2.0:1782529357.895887:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782529357.896924:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529357.897045:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117264896 00000100:00100000:1.0:1782529357.897054:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117264896 00000100:00100000:1.0:1782529357.897100:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782529357.897108:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:3297:x1869117117264896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529357.897363:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:3297:x1869117117264896:12345-0@lo:400:kworker.0 Request processed in 255us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529357.897385:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782529357.897674:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117264896:0@lo:400:kworker.0 00010000:00010000:0.0:1782529358.470937:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782529358.876332:0:15251:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782529359.495327:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529360.542280:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529361.550355:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529362.568004:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782529363.015355:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782529363.015362:0:12767:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782529363.015364:0:12767:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782529363.015367:0:12767:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782529363.015432:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117265536:0@lo:400:kworker.0 00000100:00100000:0.0:1782529363.015508:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529363.015586:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117265536 00000100:00100000:0.0:1782529363.015592:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117265536 00000100:00100000:0.0:1782529363.015640:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782529363.015649:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117265536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529363.015887:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117265408:0@lo:400:kworker.0 00000100:00100000:1.0:1782529363.015920:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529363.015964:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782529363.015971:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117265280:0@lo:400:kworker.0 00000100:00100000:1.0:1782529363.015999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529363.016045:0:14252:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782529363.016054:0:14252:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1782529363.016066:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529363.016083:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117265280 00000100:00100000:1.0:1782529363.016087:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117265280 00000100:00100000:1.0:1782529363.016115:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782529363.016121:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:3297:x1869117117265280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529363.016165:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:3297:x1869117117265280:12345-0@lo:400:kworker.0 Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529363.016172:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782529363.016213:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117265280:0@lo:400:kworker.0 00000100:00100000:2.0:1782529363.017014:0:14251:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782529363.017026:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117265408 00000100:00100000:2.0:1782529363.017039:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117265408 00000100:00100000:2.0:1782529363.017061:0:14251:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782529363.017068:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782529363.017075:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117265408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529363.017127:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117265408:12345-0@lo:400:kworker.0 Request processed in 54us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529363.017133:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782529363.017592:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117265536:12345-0@lo:400:kworker.0 Request processed in 1943us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529363.017601:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782529363.017640:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c643966680 x1869117117265536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529363.017655:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117265536:0@lo:400:kworker.0 00010000:00080000:3.0:1782529363.018133:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c643967100 x1869117117265408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782529363.018143:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117265408:0@lo:400:kworker.0 00010000:00010000:1.0:1782529363.592537:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782529363.913016:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1782529364.520111:0:15553:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782529364.520116:0:15553:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1782529364.520270:0:15553:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99c65f4cf800 00000020:01000004:2.0:1782529364.520295:0:15553:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782529364.520315:0:15553:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1782529364.520336:0:15553:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99c645aa0000) 00000020:00000080:2.0:1782529364.520359:0:15553:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782529364.536777:0:15553:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782529364.537197:0:15553:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1782529364.538085:0:15553:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782529364.538327:0:15553:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1782529364.538554:0:15553:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1782529364.543626:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:2.0:1782529364.543727:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 517: rc = 0 00100000:10000000:2.0:1782529364.543939:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 517: rc = 0 00100000:10000000:2.0:1782529364.544471:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 896: rc = 0 00100000:10000000:2.0:1782529364.544697:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 896: rc = 0 00100000:10000000:2.0:1782529364.544999:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 896: rc = 0 00100000:10000000:2.0:1782529364.545267:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 896: rc = 0 00100000:10000000:2.0:1782529364.545524:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 896: rc = 0 00100000:10000000:2.0:1782529364.545754:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 896: rc = 0 00000020:00000080:2.0:1782529364.546432:0:15553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1782529364.546449:0:15553:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782529364.546463:0:15553:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bfdc08f7eacce3 00000020:01000004:2.0:1782529364.546474:0:15553:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1782529364.546500:0:15553:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782529364.546505:0:15553:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782529364.546512:0:15553:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1782529364.546544:0:15553:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1782529364.546549:0:15553:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1782529364.556353:0:15553:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782529364.556408:0:15553:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.150@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1782529364.556413:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782529364.556416:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782529364.556418:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529364.556420:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529364.556422:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529364.556423:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529364.556425:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782529364.556428:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529364.556430:0:15553:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782529364.556435:0:15553:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1782529364.556437:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782529364.556439:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782529364.556440:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529364.556441:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529364.556442:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529364.556444:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529364.556445:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782529364.556446:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529364.556447:0:15553:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782529364.556488:0:15553:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782529364.556520:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117265664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782529364.556641:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.556785:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6516fb780 going to sleep for 11 seconds 00000100:00100000:1.0:1782529364.556966:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117265664 00000100:00100000:1.0:1782529364.556977:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117265664 00000100:00100000:1.0:1782529364.557088:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782529364.557101:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:15553:x1869117117265664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782529364.557214:0:14245:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1782529364.557218:0:14245:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1782529364.557223:0:14245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782529364.580651:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:15553:x1869117117265664:12345-0@lo:253:mount.lustre.0 Request processed in 23536us (23994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.580673:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782529364.585638:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117265664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782529364.585695:0:15553:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782529364.585699:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782529364.585701:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782529364.585703:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782529364.585704:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782529364.585706:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782529364.585708:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782529364.585710:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782529364.585712:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782529364.585714:0:15553:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782529364.586029:0:15553:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99c65f4cf800 from lustre-OST0001 10000000:01000000:2.0:1782529364.586074:0:15553:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1782529364.586078:0:15553:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782529364.586089:0:15553:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99c67f363380 local copy 00010000:00010000:2.0:1782529364.586167:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529364.587368:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117265792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782529364.588108:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.588211:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6453489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529364.591152:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117265792 00000100:00100000:1.0:1782529364.591174:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117265792 00000100:00100000:1.0:1782529364.591403:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782529364.591418:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:15553:x1869117117265792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529364.592205:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:15553:x1869117117265792:12345-0@lo:501:mount.lustre.0 Request processed in 788us (4097us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782529364.592217:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782529364.592362:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117265792:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782529364.592394:0:15553:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782529364.592607:0:15553:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782529364.592620:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.592632:0:15553:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c647d00400/0x72bfdc08f7eacb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacb5b expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529364.592675:0:15553:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99c65f4cf800 10000000:01000000:2.0:1782529364.592688:0:15553:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782529364.592696:0:15553:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782529364.592698:0:15553:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782529364.592705:0:15553:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1782529364.592708:0:15553:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782529364.592752:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eaccea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.592772:0:15553:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eaccea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.592790:0:15553:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eaccea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529364.592816:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117265920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782529364.593121:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.593616:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6453489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529364.593684:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117265920 00000100:00100000:0.0:1782529364.593692:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117265920 00000100:00100000:0.0:1782529364.593736:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782529364.593745:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:15553:x1869117117265920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782529364.594091:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529364.594115:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640030200/0x72bfdc08f7eaccf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eaccea expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529364.594147:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640030200/0x72bfdc08f7eaccf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eaccea expref: 17 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529364.594161:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640030200/0x72bfdc08f7eaccf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaccea expref: 17 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529364.594171:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640030200, rc 0) 00000100:00100000:0.0:1782529364.594287:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117265920:12345-0@lo:101:mount.lustre.0 Request processed in 542us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529364.594359:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782529364.594611:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117265920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782529364.594633:0:15553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eaccea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccf1 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.594643:0:15553:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eaccea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eaccf1 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782529364.602112:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1782529364.605657:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529364.611229:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1782529364.611307:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1782529364.611333:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1782529364.611377:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1782529364.611429:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1782529364.611455:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1782529364.611524:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1782529364.611531:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1782529364.611662:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529364.611745:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.611817:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c649ea4540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529364.611890:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117266048 00000100:00100000:1.0:1782529364.611900:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117266048 00000100:00100000:1.0:1782529364.611955:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782529364.611966:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782529364.612569:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266048:12345-0@lo:501:mount.lustre.0 Request processed in 603us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.612579:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782529364.612828:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529364.613048:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782529364.613099:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.613132:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c649ea4540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529364.613146:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117266176 00000100:00100000:1.0:1782529364.613153:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117266176 00000100:00100000:1.0:1782529364.613238:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782529364.613248:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782529364.613641:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266176:12345-0@lo:503:mount.lustre.0 Request processed in 392us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.613649:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782529364.613731:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782529364.614551:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782529364.614640:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782529364.614701:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.614746:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c649ea4540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529364.615143:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117266304 00000100:00100000:1.0:1782529364.615152:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117266304 00000100:00100000:1.0:1782529364.615230:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782529364.615240:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782529364.615521:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266304:12345-0@lo:502:mount.lustre.0 Request processed in 283us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.615530:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782529364.616071:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266304:0@lo:502:mount.lustre.0 00010000:00010000:2.0:1782529364.616113:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782529364.616414:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1782529364.616475:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1782529364.616508:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1782529364.616557:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1782529364.616592:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1782529364.616625:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1782529364.616671:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1782529364.616702:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1782529364.616745:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1782529364.616800:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782529364.618183:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.618313:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c649ea4540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529364.620437:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117266432 00000100:00100000:1.0:1782529364.620457:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117266432 00000100:00100000:1.0:1782529364.620547:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782529364.620559:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266432:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782529364.621206:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266432:12345-0@lo:502:mount.lustre.0 Request processed in 646us (3029us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.621218:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782529364.621371:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782529364.621526:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1782529364.621546:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1782529364.623029:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782529364.623044:0:15554:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1782529364.623053:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529364.623056:0:15554:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1782529364.623066:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782529364.623089:0:15554:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99c680cf3380) 00000020:00000080:0.0:1782529364.623123:0:15554:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782529364.623130:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782529364.623227:0:15554:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c65f4cf800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1782529364.623236:0:15554:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782529364.623249:0:15554:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bfdc08f7eaccff 00010000:00010000:0.0:1782529364.629652:0:15554:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1782529364.630556:0:15554:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1782529364.633571:0:15554:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1782529364.635326:0:15554:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782529364.635343:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529364.635351:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529364.635353:0:15554:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782529364.635356:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529364.635361:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529364.635363:0:15554:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782529364.635366:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782529364.635367:0:15554:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782529364.635370:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529364.635372:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529364.635373:0:15554:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782529364.635376:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782529364.635378:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529364.635379:0:15554:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782529364.635382:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782529364.635456:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782529364.635460:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782529364.635462:0:15554:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782529364.635465:0:15554:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1782529364.639423:0:15553:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1782529364.639492:0:15553:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782529364.639587:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eaccea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccf1 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.639631:0:15553:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c647d01000/0x72bfdc08f7eaccea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eaccf1 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529364.639640:0:15553:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c65f4cf800 from 1 10000000:01000000:2.0:1782529364.639643:0:15553:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782529364.639693:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.639701:0:15553:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.639713:0:15553:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529364.639745:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782529364.639993:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.641004:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6453489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529364.648332:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117266560 00000100:00100000:0.0:1782529364.648354:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117266560 00000100:00100000:0.0:1782529364.648434:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782529364.648445:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:15553:x1869117117266560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782529364.648469:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529364.648494:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacd06 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529364.648543:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 18 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529364.648555:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 18 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529364.648566:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c640031400, rc 0) 00000100:00100000:0.0:1782529364.648678:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117266560:12345-0@lo:101:mount.lustre.0 Request processed in 234us (8686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529364.648686:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782529364.648872:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782529364.648897:0:15553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.648909:0:15553:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782529364.649616:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782529364.650039:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529364.650318:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782529364.650366:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782529364.650426:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782529364.650434:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782529364.650520:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529364.650600:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.650657:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6412ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529364.652012:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117266688 00000100:00100000:0.0:1782529364.652026:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117266688 00000100:00100000:0.0:1782529364.652093:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782529364.652104:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117266688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782529364.652458:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117266688:12345-0@lo:501:mount.lustre.0 Request processed in 355us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529364.652468:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782529364.654994:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529364.655078:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782529364.655171:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.655213:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6412ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1782529364.655345:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117266816 00000100:00100000:3.0:1782529364.655351:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117266816 00000100:00100000:3.0:1782529364.655411:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782529364.655421:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117266816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782529364.655756:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117266816:12345-0@lo:503:mount.lustre.0 Request processed in 336us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529364.656807:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782529364.656928:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266816:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782529364.657982:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782529364.658093:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782529364.658173:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.658222:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645348480 going to sleep for 11 seconds 00000100:00100000:0.0:1782529364.658930:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117266944 00000100:00100000:0.0:1782529364.658940:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117266944 00000100:00100000:0.0:1782529364.659112:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782529364.659133:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117266944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782529364.659442:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117266944:12345-0@lo:502:mount.lustre.0 Request processed in 319us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529364.659450:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782529364.659539:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117266944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782529364.659809:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1782529364.659929:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1782529364.659976:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1782529364.660015:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1782529364.660043:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1782529364.660083:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1782529364.660112:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1782529364.660141:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1782529364.660183:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782529364.660236:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.664922:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645348480 going to sleep for 11 seconds 00000100:00100000:1.0:1782529364.665308:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117267072 00000100:00100000:1.0:1782529364.665321:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117267072 00000100:00100000:1.0:1782529364.665555:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782529364.665567:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117267072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782529364.665926:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117267072:12345-0@lo:502:mount.lustre.0 Request processed in 360us (5688us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.665936:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782529364.666256:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782529364.666463:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1782529364.666483:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1782529364.669512:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529364.669531:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529364.669548:0:15558:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782529364.669557:0:15558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c65f4cf800 00000020:00000080:1.0:1782529364.669560:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782529364.669570:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529364.669572:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529364.669573:0:15558:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782529364.669576:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529364.669579:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529364.669580:0:15558:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782529364.669583:0:15558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99c65f4cf800 00000020:00000080:1.0:1782529364.669585:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782529364.669738:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529364.669742:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529364.669744:0:15558:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782529364.669747:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782529364.669750:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529364.669751:0:15558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782529364.669755:0:15558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99c65f4cf800 00000020:00000080:1.0:1782529364.669767:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782529364.671552:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782529364.671566:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782529364.671568:0:15558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782529364.671573:0:15558:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1782529364.672983:0:15553:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782529364.673035:0:15553:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782529364.673062:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.673076:0:15553:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782529364.673140:0:15553:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782529364.673143:0:15553:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99c65f4cf800 10000000:01000000:3.0:1782529364.673147:0:15553:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99c65f4cf800 10000000:01000000:3.0:1782529364.673152:0:15553:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782529364.673158:0:15553:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff99c65f4cf800 from 1 10000000:01000000:3.0:1782529364.673161:0:15553:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782529364.673208:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eacd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.673217:0:15553:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eacd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.673228:0:15553:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eacd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529364.673261:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782529364.673360:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529364.678451:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117267200 00000100:00100000:1.0:1782529364.678472:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117267200 00000100:00100000:1.0:1782529364.678546:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782529364.678556:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117267200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782529364.678578:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529364.678600:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c6587c6a00/0x72bfdc08f7eacd1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacd14 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.678634:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c6587c6a00/0x72bfdc08f7eacd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacd14 expref: 19 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.678654:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c6587c6a00/0x72bfdc08f7eacd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacd14 expref: 19 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.678665:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c6587c6a00, rc 0) 00000100:00100000:1.0:1782529364.678737:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267200:12345-0@lo:101:mount.lustre.0 Request processed in 182us (5378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.678745:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782529364.681070:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529364.681122:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782529364.681151:0:15553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eacd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd1b expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.681166:0:15553:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eacd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacd1b expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782529364.683147:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1782529364.683593:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529364.685108:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1782529364.685191:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1782529364.685227:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1782529364.685273:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1782529364.685309:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1782529364.685354:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1782529364.685387:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1782529364.685418:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1782529364.685464:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1782529364.685501:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1782529364.685532:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1782529364.685575:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1782529364.685607:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1782529364.685636:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1782529364.685678:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1782529364.685711:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1782529364.685742:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1782529364.685799:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1782529364.687016:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1782529364.687105:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1782529364.687188:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1782529364.687226:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1782529364.687258:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1782529364.687307:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1782529364.687342:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1782529364.687376:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1782529364.687426:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1782529364.687461:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1782529364.687494:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1782529364.687540:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1782529364.687573:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1782529364.687603:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1782529364.687634:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1782529364.687678:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1782529364.687712:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1782529364.688939:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1782529364.689061:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1782529364.689179:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1782529364.689188:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1782529364.689320:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529364.689419:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.689473:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117267328 00000100:00100000:3.0:1782529364.689481:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117267328 00000100:00100000:3.0:1782529364.689536:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782529364.689546:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529364.690963:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267328:12345-0@lo:501:mount.lustre.0 Request processed in 289us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529364.690978:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782529364.691058:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529364.691089:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782529364.691155:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782529364.691212:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.691233:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782529364.692167:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117267456 00000100:00100000:2.0:1782529364.692178:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117267456 00000100:00100000:2.0:1782529364.692226:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782529364.692237:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782529364.692608:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267456:12345-0@lo:503:mount.lustre.0 Request processed in 372us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529364.692615:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782529364.692646:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782529364.693551:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782529364.693651:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782529364.693719:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.693782:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fefd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782529364.695067:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117267584 00000100:00100000:2.0:1782529364.695084:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117267584 00000100:00100000:2.0:1782529364.695157:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782529364.695169:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782529364.695582:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267584:12345-0@lo:502:mount.lustre.0 Request processed in 414us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529364.695592:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782529364.695824:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782529364.696406:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1782529364.696468:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1782529364.696498:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1782529364.696568:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1782529364.696604:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1782529364.696659:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1782529364.696693:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1782529364.696722:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1782529364.696778:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1782529364.696811:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1782529364.696984:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1782529364.697035:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1782529364.697067:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1782529364.697100:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1782529364.697148:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1782529364.697183:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1782529364.697215:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1782529364.697259:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1782529364.697291:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1782529364.697321:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1782529364.697363:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1782529364.697417:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1782529364.697450:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1782529364.697496:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1782529364.700979:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1782529364.701357:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1782529364.701448:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1782529364.701486:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1782529364.701516:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1782529364.701563:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1782529364.701599:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1782529364.701629:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1782529364.701659:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1782529364.701701:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1782529364.701734:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1782529364.701790:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1782529364.701864:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1782529364.702207:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1782529364.702258:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1782529364.702291:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1782529364.702356:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782529364.702457:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.702558:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66060a300 going to sleep for 11 seconds 00000100:00100000:3.0:1782529364.707284:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117267712 00000100:00100000:3.0:1782529364.707303:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117267712 00000100:00100000:2.0:1782529364.707452:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782529364.707466:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782529364.709044:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267712:12345-0@lo:502:mount.lustre.0 Request processed in 1571us (6578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529364.709059:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782529364.710075:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782529364.710270:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1782529364.710292:0:15553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1782529364.716188:0:15563:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782529364.716211:0:15563:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99c679f93380) 00000020:00000080:3.0:1782529364.716240:0:15563:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1782529364.716685:0:15563:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99c65f4cf800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782529364.716691:0:15563:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99c65f4cf800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782529364.716694:0:15563:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99c65f4cf800 3 00010000:00080000:3.0:1782529364.716740:0:15563:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99c541132800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1782529364.718530:0:15563:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1782529364.718662:0:15563:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782529364.718709:0:15563:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782529364.718728:0:15563:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72bfdc08f7eacd29 00000100:00080000:3.0:1782529364.718743:0:15563:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782529364.722883:0:15563:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99c541132800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1782529364.722955:0:15563:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67f1d7b80 x1869117117267840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782529364.722987:0:15563:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782529364.723345:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3293:1869117117267840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782529364.723442:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1782529364.723747:0:15563:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1782529364.724141:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117267840 00000100:00100000:3.0:1782529364.724150:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117267840 00000100:00100000:3.0:1782529364.724198:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782529364.724208:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3293:x1869117117267840:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782529364.724241:0:14251:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1782529364.724284:0:14251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72bfdc08f7eacd30 00000004:00100000:3.0:1782529364.724306:0:14251:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782529364.724346:0:14251:0:(import.c:65:import_set_state_nolock()) ffff99c541136800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782529364.724459:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869117117267840:12345-0@lo:38:llog_process_th.0 Request processed in 251us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529364.724468:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:3.0:1782529364.724494:0:15553:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1782529364.724522:0:15553:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782529364.724539:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eacd14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd1b expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.724551:0:15553:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c682044a00/0x72bfdc08f7eacd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd1b expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782529364.724637:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782529364.724640:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782529364.724642:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529364.724643:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529364.724645:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529364.724646:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529364.724652:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529364.724655:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529364.724656:0:15553:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782529364.724661:0:15553:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1782529364.724663:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782529364.724665:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782529364.724666:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529364.724667:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529364.724668:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529364.724669:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529364.724670:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529364.724671:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529364.724672:0:15553:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782529364.724690:0:15553:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782529364.724706:0:15553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267968:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782529364.724768:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529364.724796:0:15553:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fef600 going to sleep for 11 seconds 00000100:00100000:3.0:1782529364.724815:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117267968 00000100:00100000:3.0:1782529364.724819:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117267968 00000100:00100000:3.0:1782529364.725078:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782529364.725087:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:15553:x1869117117267968:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782529364.725111:0:14244:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782529364.725129:0:14244:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1782529364.726201:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782529364.726208:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782529364.726211:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782529364.726213:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782529364.726272:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782529364.726284:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117268096:0@lo:400:kworker.0 00000100:00100000:2.0:1782529364.726331:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.726361:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117268224:0@lo:400:kworker.0 00000100:00100000:2.0:1782529364.726386:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.726423:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117268096 00000100:00100000:2.0:1782529364.726430:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117268096 00000100:00100000:2.0:1782529364.726463:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117268224 00000100:00100000:2.0:1782529364.726465:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117268224 00000100:00100000:2.0:1782529364.726479:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782529364.726491:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117268096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529364.726530:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117268096:12345-0@lo:400:kworker.0 Request processed in 39us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529364.726535:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782529364.726548:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782529364.726552:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117268224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529364.726568:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1869117117268224:12345-0@lo:400:kworker.0 Request processed in 17us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529364.726572:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782529364.726600:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c67fae5500 x1869117117268224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529364.726611:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1869117117268224:0@lo:400:kworker.0 00010000:00080000:2.0:1782529364.726632:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c67fae7b80 x1869117117268096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529364.726637:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117268096:0@lo:400:kworker.0 00010000:00080000:0.0:1782529364.728221:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99c67f1d7b80 x1869117117267840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782529374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529364.728235:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782529364.728247:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1782529364.728256:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782529364.728262:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782529364.728266:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c541132800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782529364.728273:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3293:1869117117267840:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1782529364.749054:0:14244:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782529364.749070:0:14244:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1782529364.749515:0:14267:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782529364.749521:0:14267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782529364.749549:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.749574:0:14267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 19 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.749583:0:14267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.749634:0:14267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 19 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529364.749667:0:14267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 19 pid: 14244 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529364.749685:0:14267:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14267:1869117117268352:0@lo:104: 00000100:00100000:2.0:1782529364.749781:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529364.749869:0:14267:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529364.750055:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117268352 00000100:00100000:1.0:1782529364.750065:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117268352 00000100:00100000:1.0:1782529364.750116:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529364.750127:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:14267:x1869117117268352:12345-0@lo:104: 00010000:00010000:1.0:1782529364.750142:0:14235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750217:0:14235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782529364.750225:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:14267:x1869117117268352:12345-0@lo:104: Request processed in 99us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.750232:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782529364.750259:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529364.750266:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750275:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01200 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:1.0:1782529364.750280:0:14240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750299:0:14240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782529364.750306:0:14240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529364.750312:0:14240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782529364.750345:0:14240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750351:0:14240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782529364.750376:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750384:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c647d01200/0x72bfdc08f7eaccce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eaccd5 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750402:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529364.750404:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529364.750406:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529364.750429:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117268480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782529364.750462:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529364.750511:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117268480 00000100:00100000:1.0:1782529364.750516:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117268480 00010000:00010000:1.0:1782529364.750533:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 20 pid: 14244 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529364.750554:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529364.750559:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+20:3297:x1869117117268480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782529364.750579:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529364.750585:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 20 pid: 14244 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750595:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 20 pid: 14244 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750614:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750624:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782529364.750640:0:14236:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005695645s 00010000:00010000:1.0:1782529364.750644:0:14236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750651:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750658:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750664:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750670:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529364.750675:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750683:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750699:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529364.750709:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529364.750737:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+20:3297:x1869117117268480:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529364.750745:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529364.750796:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117268480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782529364.751005:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c6587c7200/0x72bfdc08f7eaccd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eaccce expref: 19 pid: 14244 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529364.751016:0:14267:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14267:1869117117268352:0@lo:104: 00010000:00010000:3.0:1782529364.751033:0:14267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.751042:0:14267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.751060:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529364.751067:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacd37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529364.764962:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:15553:x1869117117267968:12345-0@lo:253:mount.lustre.0 Request processed in 39864us (40192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529364.764979:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782529364.765243:0:15553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dec586b-6fd4-4acc-b993-13a64cbeab0a:15553:1869117117267968:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782529364.765265:0:15553:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782529364.765269:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782529364.765271:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782529364.765273:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782529364.765274:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782529364.765275:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782529364.765277:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782529364.765278:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782529364.765281:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782529364.765282:0:15553:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782529364.765302:0:15553:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782529364.770706:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529364.770976:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782529364.771148:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529364.771307:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782529364.771449:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782529364.771667:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782529364.773286:0:15553:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1782529364.819329:0:15553:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782529364.819339:0:15553:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782529364.819461:0:15553:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782529364.819542:0:15553:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782529364.819564:0:15553:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782529364.819601:0:15553:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1782529365.643648:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782529366.599936:0:14248:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782529366.599948:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff99c67f8f1800 from 8 10000000:01000000:1.0:1782529366.599956:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782529366.600022:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacd3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.600047:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacd3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.600061:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacd3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529366.600098:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117268608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529366.600191:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529366.600266:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c647fe3180 going to sleep for 11 seconds 00000100:00100000:2.0:1782529366.600583:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117268608 00000100:00100000:2.0:1782529366.600593:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117268608 00000100:00100000:2.0:1782529366.600667:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782529366.600677:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:14248:x1869117117268608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782529366.600695:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529366.600714:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eacd45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacd3e expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.600755:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eacd45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacd3e expref: 19 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.600768:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d00a00/0x72bfdc08f7eacd45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacd3e expref: 19 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.600779:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00a00, rc 0) 00000100:00100000:2.0:1782529366.600907:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:14248:x1869117117268608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529366.600915:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782529366.601068:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117268608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529366.601088:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacd3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd45 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.601097:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacd3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacd45 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529366.601170:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643965f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117268736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782529366.601209:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529366.601235:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66722b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529366.601513:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117268736 00000100:00100000:2.0:1782529366.601519:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117268736 00000100:00100000:2.0:1782529366.601557:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782529366.601565:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:14248:x1869117117268736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782529366.601582:0:14244:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782529366.601604:0:14244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782529366.601607:0:14244:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1782529366.601701:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:14248:x1869117117268736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529366.601709:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782529366.601877:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643965f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117268736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782529366.601956:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782529366.601966:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacd3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd45 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.601986:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c6587c7c00/0x72bfdc08f7eacd3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacd45 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.663534:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529366.795678:0:3293:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782529351/real 1782529351] req@ffff99c678319f80 x1869117117261440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782529366 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529366.795710:0:3293:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99c678319f80 x1869117117261440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782529366 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529366.795720:0:3293:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782529351/real 1782529351] req@ffff99c67831b480 x1869117117261568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782529366 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529366.795732:0:3293:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99c67831b480 x1869117117261568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782529366 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782529366.795760:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6772d3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782529366.795783:0:3293:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782529366.795787:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117261440:0@lo:8:kworker.0 00000100:00080000:0.0:1782529366.795792:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6783b9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782529366.795797:0:3293:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782529366.795800:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117261568:0@lo:8:kworker.0 00000100:00080000:2.0:1782529366.795992:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782529366.795997:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782529366.796000:0:38:0:(import.c:65:import_set_state_nolock()) ffff99c6772d3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782529366.796005:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1782529366.796010:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782529366.796016:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99c6772d3800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1782529366.796050:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67fae7100 x1869117117268864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782529366.796081:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782529366.796084:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782529366.796086:0:38:0:(import.c:65:import_set_state_nolock()) ffff99c6783b9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782529366.796089:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1782529366.796099:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782529366.796103:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99c6783b9000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1782529366.796115:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99c67fae5180 x1869117117268992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782529366.797460:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117268864:0@lo:8:kworker.0 00000100:00100000:0.0:1782529366.797545:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529366.797598:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117268992:0@lo:8:kworker.0 00000100:00100000:0.0:1782529366.797626:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529366.799709:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117269376:0@lo:400:kworker.0 00000100:00100000:0.0:1782529366.799807:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529366.799884:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117269248:0@lo:400:kworker.0 00000100:00100000:0.0:1782529366.799911:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529366.799932:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529366.799939:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117269120:0@lo:400:kworker.0 00000100:00100000:0.0:1782529366.799958:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529366.800003:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117269376 00000100:00100000:0.0:1782529366.800009:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117269376 00000100:00100000:0.0:1782529366.800057:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117269248 00000100:00100000:0.0:1782529366.800060:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117269248 00000100:00100000:0.0:1782529366.800071:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117269120 00000100:00100000:0.0:1782529366.800074:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117269120 00000100:00100000:0.0:1782529366.800087:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782529366.800095:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117269376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529366.800147:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117269376:12345-0@lo:400:kworker.0 Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529366.800154:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782529366.800171:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782529366.800176:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117269248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529366.800204:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117269248:12345-0@lo:400:kworker.0 Request processed in 28us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529366.800210:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782529366.800220:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782529366.800225:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117269120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529366.800249:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869117117269120:12345-0@lo:400:kworker.0 Request processed in 24us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529366.800254:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782529366.800291:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117268864 00000100:00100000:0.0:1782529366.800295:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117268864 00000100:00100000:0.0:1782529366.800321:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117268992 00000100:00100000:0.0:1782529366.800324:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117268992 00000100:00100000:0.0:1782529366.800335:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782529366.800339:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3293:x1869117117268864:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782529366.800361:0:14887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1782529366.800389:0:14887:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eacd4c 00002000:00100000:0.0:1782529366.800403:0:14887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99c54212b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113663 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1782529366.800407:0:14887:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1782529366.800410:0:14887:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782529366.800712:0:14887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782529366.801660:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782529366.803058:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae4380 x1869117117269376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529366.803080:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117269376:0@lo:400:kworker.0 00010000:00080000:1.0:1782529366.803154:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae4700 x1869117117269120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529366.803164:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869117117269120:0@lo:400:kworker.0 00010000:00080000:1.0:1782529366.803176:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae7480 x1869117117269248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782529366.803185:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117269248:0@lo:400:kworker.0 00000100:00080000:0.0:1782529366.806801:0:14887:0:(import.c:65:import_set_state_nolock()) ffff99c542128000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529366.807804:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1869117117268864:12345-0@lo:8:kworker.0 Request processed in 7457us (10254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529366.807822:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782529366.808017:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782529366.808025:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3293:x1869117117268992:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1782529366.808051:0:14887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:1.0:1782529366.808073:0:14887:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bfdc08f7eacd53 00002000:00100000:1.0:1782529366.808085:0:14887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99c6795cf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113663 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1782529366.808088:0:14887:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1782529366.808090:0:14887:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782529366.808320:0:14887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782529366.808344:0:14887:0:(import.c:65:import_set_state_nolock()) ffff99c6795c9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529366.808382:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1869117117268992:12345-0@lo:8:kworker.0 Request processed in 357us (10756us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529366.808386:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782529366.809040:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae7100 x1869117117268864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782529386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529366.809049:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782529366.809055:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782529366.809062:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782529366.809066:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782529366.809068:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6772d3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782529366.809112:0:3293:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782529366.809117:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117268864:0@lo:8:kworker.0 00010000:00080000:0.0:1782529366.809131:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae5180 x1869117117268992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782529386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529366.809138:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782529366.809142:0:3293:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782529366.809146:0:3293:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782529366.809156:0:3293:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000004:00080000:1.0:1782529366.809157:0:14274:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00080000:0.0:1782529366.809159:0:3293:0:(import.c:65:import_set_state_nolock()) ffff99c6783b9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782529366.809169:0:3293:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782529366.809172:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3293:1869117117268992:0@lo:8:kworker.0 00000100:00100000:1.0:1782529366.809176:0:14274:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14274:1869117117269632:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1782529366.809202:0:14275:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1782529366.809214:0:14274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529366.809240:0:14274:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c647fe3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782529366.809258:0:14886:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117269632 00000100:00100000:1.0:1782529366.809263:0:14886:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117269632 00000100:00100000:1.0:1782529366.809302:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529366.809309:0:14886:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14274:x1869117117269632:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1782529366.809587:0:14275:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428721753172ns, next at 0ns, rc = 0 00000004:00080000:2.0:1782529366.809684:0:14273:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782529366.809959:0:14273:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428722124949ns, next at 0ns, rc = 0 00000004:00080000:2.0:1782529366.810001:0:14276:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1782529366.810015:0:14276:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14276:1869117117269888:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782529366.810051:0:14276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529366.810070:0:14276:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646fef600 going to sleep for 11 seconds 00000100:00100000:2.0:1782529366.811329:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117269760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529366.811672:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529366.811732:0:14887:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782529366.811751:0:14887:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1782529366.812060:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117269504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529366.812091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529366.812127:0:14890:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117269760 00000100:00100000:2.0:1782529366.812134:0:14890:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117269760 00000100:00100000:2.0:1782529366.812166:0:14890:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117269504 00000100:00100000:2.0:1782529366.812169:0:14890:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117269504 00000100:00100000:2.0:1782529366.812185:0:14890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529366.812192:0:14890:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869117117269760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782529366.812222:0:14890:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529366.812263:0:14890:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869117117269760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529366.812270:0:14890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529366.812288:0:14890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782529366.812299:0:14890:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1869117117269504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782529366.812318:0:14890:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782529366.812349:0:14890:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1869117117269504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529366.812750:0:14888:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1782529366.812764:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117269888 00000100:00100000:1.0:1782529366.812768:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117269888 00000100:00080000:0.0:1782529366.812889:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782529366.812894:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529366.813899:0:14890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782529366.813958:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c678318380 x1869117117269504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529366.813979:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117269504:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1782529366.814014:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67fae5f80 x1869117117269760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782529382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782529366.814028:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117269760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529366.814154:0:15665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782529366.814167:0:15665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14276:x1869117117269888:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1782529366.817007:0:14886:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1782529366.817017:0:14886:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1782529366.817023:0:14886:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00080000:0.0:1782529366.824219:0:15665:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1782529366.824229:0:15665:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1782529366.824234:0:15665:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1782529366.827048:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.827060:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827078:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.827082:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.827089:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827107:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827117:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827126:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827156:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782529366.827630:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.827636:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827645:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.827648:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.827652:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827662:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827670:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827678:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827694:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782529366.827706:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782529366.827711:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827720:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.827731:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827752:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827770:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827777:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6981a94/0x72bfdc08f7eacd5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827794:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.827797:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827804:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.827807:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827814:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827824:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827850:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2bdb375/0x72bfdc08f7eacd61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.827871:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.827873:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.827874:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.828270:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.828276:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828285:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.828288:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.828293:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828302:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828311:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828318:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828333:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529366.828342:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.828345:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828362:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.828365:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828373:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828383:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828391:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0a683d/0x72bfdc08f7eacd68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.828404:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.828406:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.828408:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529366.831018:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.831490:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.831501:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.831517:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.831521:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.831752:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.831768:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.831786:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.831794:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.832674:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782529366.833248:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.833256:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.833270:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.833274:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.833279:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.833292:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.833301:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.833309:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833419:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782529366.833427:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833436:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c6c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529366.833440:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833449:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833469:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833488:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009067fb1c/0x72bfdc08f7eacd6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833508:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529366.833511:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833518:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529366.833522:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833661:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833673:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.833683:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529366.833684:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529366.833687:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.833860:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782529366.833866:0:14886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4520b58/0x72bfdc08f7eacd76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.833888:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.834322:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.834329:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834339:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.834343:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.834348:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834358:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834366:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834373:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834388:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529366.834397:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.834406:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834413:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.834416:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834424:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834436:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834442:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309cccda/0x72bfdc08f7eacd7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834456:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.834457:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.834459:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.834871:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.834877:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834885:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.834888:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.834893:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834914:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834922:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834927:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834941:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529366.834949:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.834953:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834960:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.834963:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834970:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834981:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.834989:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000208ce93d/0x72bfdc08f7eacd84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835009:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.835010:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.835012:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.835435:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.835440:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835450:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.835453:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.835457:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835466:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835475:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835482:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835496:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529366.835504:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.835508:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835525:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.835529:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835536:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835548:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835555:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cbf3920/0x72bfdc08f7eacd8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.835569:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.835571:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.835573:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.836165:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.836172:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836181:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.836183:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.836188:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836196:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836209:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836215:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836230:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529366.836238:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.836242:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836249:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577800 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.836252:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836259:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836270:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836278:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d4463ec/0x72bfdc08f7eacd92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836291:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.836298:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.836300:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.836859:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.836866:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836875:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.836878:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.836883:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836892:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836901:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836908:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836922:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529366.836931:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.836935:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836942:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.836945:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836964:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836976:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836983:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062e43f9c/0x72bfdc08f7eacd99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.836999:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.837000:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.837002:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.837393:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.837399:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837407:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.837410:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.837414:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837423:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837431:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837444:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837458:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529366.837467:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.837471:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837477:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.837481:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837488:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837500:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837507:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e2c82d9/0x72bfdc08f7eacda0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.837520:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.837522:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.837954:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.838364:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.838379:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.838389:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.838392:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.838397:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.838408:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.838416:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.838424:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.838451:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782529366.838917:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529366.838924:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.838932:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529366.838941:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.838950:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.838965:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.838972:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfb9e3a7/0x72bfdc08f7eacda7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.838990:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529366.838992:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529366.838993:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.839376:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.839383:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839392:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.839395:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.839399:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839409:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839423:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839429:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839490:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782529366.839932:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.839938:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839946:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.839949:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.839953:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839962:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839969:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.839976:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841165:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782529366.841176:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841186:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529366.841191:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841199:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841217:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841231:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8df14aa/0x72bfdc08f7eacdae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841251:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529366.841255:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841261:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529366.841263:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841270:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841279:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529366.841285:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529366.841286:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529366.841288:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.841752:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.841824:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842079:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.842084:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.842090:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842106:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842115:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842133:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842173:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.842183:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.842187:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842194:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.842197:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842205:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842217:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842224:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f531a197/0x72bfdc08f7eacdbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.842238:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.842239:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.842241:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.842771:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782529366.842778:0:14886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008722d198/0x72bfdc08f7eacdb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.842804:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.843098:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.843111:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843121:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.843124:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.843129:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843139:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843147:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843155:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843168:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.843176:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.843179:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843186:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.843190:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843198:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843215:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782529366.843219:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.843223:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf919b63/0x72bfdc08f7eacdc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843224:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843232:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.843235:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.843236:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.843238:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.843239:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.843240:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.843248:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843256:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843263:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843274:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782529366.843281:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.843289:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843296:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a577a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.843300:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843307:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843318:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843325:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d77289fd/0x72bfdc08f7eacdca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.843337:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.843339:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529366.843340:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.844394:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.844403:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844414:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.844417:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.844422:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844431:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844438:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844445:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844469:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.844479:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.844483:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844489:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031800 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.844492:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844499:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844511:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844518:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f50a8bce/0x72bfdc08f7eacdd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.844647:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.844650:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.844652:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.845289:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.845296:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845306:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.845326:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.845332:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845342:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845350:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845358:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845376:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.845386:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.845390:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845397:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.845401:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845409:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845420:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845437:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0d89959/0x72bfdc08f7eacdd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845453:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.845455:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.845456:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.845897:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.845903:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.845912:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.845915:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.845919:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.845938:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.845952:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.845959:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.845979:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.845983:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.845988:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.845996:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c64a576400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.845999:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846007:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846021:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846028:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f500aec/0x72bfdc08f7eacddf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846045:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.846046:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.846048:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.846259:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.846265:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846273:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.846276:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.846280:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846290:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846298:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846371:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846385:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782529366.846393:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.846393:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.846397:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846399:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846404:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.846407:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.846407:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846410:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.846414:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846423:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846425:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846431:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846436:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846443:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e49f7fd/0x72bfdc08f7eacde6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846447:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846456:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.846458:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782529366.846460:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846466:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670570200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.846469:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846477:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846486:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846493:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2d92578/0x72bfdc08f7eacded lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846513:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.846515:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.846517:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.846522:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.846827:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.846849:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846858:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.846861:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.846865:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846873:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846880:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846886:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.846903:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.846929:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.846934:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846941:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.846944:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846952:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846963:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846970:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057b35d2f/0x72bfdc08f7eacdf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.846982:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.846984:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.846985:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.847184:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.847189:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847201:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.847204:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.847208:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847217:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847225:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847232:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847243:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782529366.847246:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.847250:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529366.847251:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847253:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847261:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529366.847263:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.847264:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847266:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.847270:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847272:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847280:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847288:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847293:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847295:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847301:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bda792be/0x72bfdc08f7eacdfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847307:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.847388:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.847392:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847399:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670570e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.847402:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847410:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847420:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847428:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcaf0ef5/0x72bfdc08f7eace02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847439:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.847441:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.847447:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.847453:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.847654:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.847660:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847668:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.847671:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.847675:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847683:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847701:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847708:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.847727:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.847949:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.847954:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847961:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.847964:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847970:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847980:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847986:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007b27a14/0x72bfdc08f7eace09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.847999:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.848000:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.848002:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.848127:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.848132:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848140:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.848143:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.848151:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848160:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848168:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848175:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848187:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.848194:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.848197:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848204:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.848206:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848213:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848222:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848238:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012876a7f/0x72bfdc08f7eace10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.848250:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.848251:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.848253:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.852260:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.852272:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.852288:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.852292:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.852298:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.852312:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.852323:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.852330:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782529366.852365:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.852372:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.852376:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.852381:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.852384:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.852388:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852397:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852405:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852413:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852427:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.852432:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852445:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.852449:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852458:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852476:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852483:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7eace17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.852501:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.852503:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.852504:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.852515:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.852522:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.852526:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.854041:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640030000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.854047:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.854069:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.854084:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.854092:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b329d53/0x72bfdc08f7eace1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.854184:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.854187:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.854188:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.855299:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.855322:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855335:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.855339:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.855344:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855357:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855367:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855381:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855395:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.855404:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.855409:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855416:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.855420:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855427:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855441:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855448:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855462:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.855464:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.855465:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.855575:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.855581:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.855590:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.855594:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.855597:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.855606:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.855613:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.855620:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.855636:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.855658:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.855667:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855674:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.855677:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855685:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855696:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855703:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7eace2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.855716:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.855717:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.855718:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.856062:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.856067:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856074:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.856082:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.856086:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856094:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856102:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856108:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856126:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.856129:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.856133:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856140:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670570a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.856143:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856161:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856172:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856180:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000155edc1f/0x72bfdc08f7eace33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856192:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.856193:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.856195:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.856476:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.856482:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856490:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.856493:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.856496:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782529366.856499:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.856505:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856506:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856513:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.856514:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856516:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.856520:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856527:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856529:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856545:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.856921:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856935:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856947:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1782529366.856949:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.856951:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856954:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856958:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.856961:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856962:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.856965:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.856969:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856970:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856979:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856981:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856988:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.856989:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b14c196/0x72bfdc08f7eace3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.856995:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857001:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.857002:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.857005:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.857006:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782529366.857022:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670570000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.857026:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857033:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857043:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857050:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009246806b/0x72bfdc08f7eace48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857062:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.857064:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.857065:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.857071:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.857079:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.857086:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.857089:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857096:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.857099:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857118:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857128:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857135:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eace41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857148:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.857150:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.857151:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.857384:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.857389:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.857402:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.857405:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.857409:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.857418:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.857426:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.857433:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.857451:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.857701:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.857707:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857714:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670570600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.857717:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857725:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.857737:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.858083:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed09a3cd/0x72bfdc08f7eace4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.858098:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.858099:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.858101:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.859235:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.859245:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.859257:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.859261:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.859266:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.859278:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.859288:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.859296:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.860346:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.860368:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.860381:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.860392:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.860396:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.860406:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.860425:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.860432:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eace56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.860452:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.860454:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.860456:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.861144:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.861152:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861164:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.861168:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.861173:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861193:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861203:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861211:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861228:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.861237:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.861242:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861249:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.861252:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861260:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861270:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861278:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eace5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861296:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.861297:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.861299:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782529366.861642:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782529366.861649:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.861657:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1782529366.861660:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529366.861664:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.861673:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.861691:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.861699:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529366.861720:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.861724:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.861729:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861736:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670570400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.861750:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861767:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861779:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861786:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3e0b79c/0x72bfdc08f7eace64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.861801:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.861802:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.861804:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1782529366.861922:0:14886:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1782529366.862015:0:14886:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14274:x1869117117269632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 52702us (52796us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529366.862024:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782529366.862080:0:14274:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14274:1869117117269632:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782529366.862094:0:14274:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1782529366.862136:0:14274:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14274:1869117117270016:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1782529366.862168:0:14274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1782529366.862187:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.862193:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529366.862199:0:14274:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c647fe3e40 going to sleep for 11 seconds 00010000:00010000:0.0:1782529366.862210:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.862213:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782529366.862214:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117270016 00010000:00010000:0.0:1782529366.862217:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529366.862220:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117270016 00010000:00010000:0.0:1782529366.862226:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.862234:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.862240:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.862251:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782529366.862254:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1782529366.862258:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782529366.862261:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14274:x1869117117270016:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1782529366.862262:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.862268:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.862271:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.862278:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782529366.862295:0:14888:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1782529366.862297:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.862377:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eace6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.862394:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.862396:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.862397:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.863100:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.863107:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863116:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.863119:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.863123:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863133:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863140:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863148:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863172:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.863181:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.863185:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863191:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.863194:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863202:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863215:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863222:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eace72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.863235:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.863237:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.863238:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.864006:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.864013:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864022:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.864031:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.864036:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864046:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864055:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864062:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864076:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.864085:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.864089:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864096:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.864099:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864106:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864117:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864136:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a3892fe/0x72bfdc08f7eace79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864150:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.864152:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.864153:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.864939:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.864948:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864959:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.864962:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.864967:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864978:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864986:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.864993:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865008:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.865017:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.865026:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865033:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.865037:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865045:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865058:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865065:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ffe784/0x72bfdc08f7eace80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865080:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.865081:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.865083:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.865610:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.865616:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865624:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.865627:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.865631:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865649:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865657:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865664:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865677:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.865685:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.865689:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865695:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.865698:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865705:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865716:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865723:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000180f126a/0x72bfdc08f7eace87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.865754:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.865756:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.865846:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782529366.865946:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1782529366.866300:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.866375:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866384:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.866387:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.866391:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866401:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866409:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866416:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866429:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.866438:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.866441:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866457:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.866459:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866466:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866477:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866483:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd495074/0x72bfdc08f7eace8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.866496:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.866498:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.866500:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.867137:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.867144:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867153:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.867157:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.867161:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867171:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867183:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867190:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867203:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.867212:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.867216:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867222:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.867226:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867233:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867244:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867250:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8d0c16/0x72bfdc08f7eace95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867261:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.867268:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.867269:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.867976:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.867983:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.867992:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.867995:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.868000:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868009:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868017:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868024:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868038:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.868046:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.868051:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868058:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.868061:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868078:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868089:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868096:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005390c9ad/0x72bfdc08f7eace9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868108:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.868110:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.868112:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.868648:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.868654:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868662:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.868664:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.868668:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868677:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868684:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868702:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868716:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.868725:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.868729:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868736:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.868750:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868827:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868932:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868940:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c308b46/0x72bfdc08f7eacea3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.868954:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.868956:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.868958:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.869450:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.869465:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869473:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.869476:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.869481:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869491:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869500:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869507:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869521:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.869530:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.869601:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869609:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8800 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.869612:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869620:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869637:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869644:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e510037f/0x72bfdc08f7eaceaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.869660:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.869661:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.869663:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.870248:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.870254:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870262:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.870265:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.870269:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870278:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870285:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870291:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870389:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.870398:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.870402:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870409:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.870412:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870420:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870431:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870438:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8ed52dd/0x72bfdc08f7eaceb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.870450:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.870451:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.870453:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.871075:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.871081:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871090:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.871098:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.871102:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871112:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871121:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871128:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871140:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.871148:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.871152:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871159:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.871163:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871170:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871181:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871198:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005758b316/0x72bfdc08f7eaceb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871210:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.871212:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.871213:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.871734:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.871749:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871828:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.871846:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.871851:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871935:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871944:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871951:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871965:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.871974:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.871984:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.871991:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.871994:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872003:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872015:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872022:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074929b7d/0x72bfdc08f7eacebf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872035:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.872037:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.872038:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.872507:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.872513:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872522:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.872525:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.872529:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872615:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872624:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872632:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872645:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.872653:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.872657:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872664:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.872668:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872676:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872686:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872692:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc83e95/0x72bfdc08f7eacec6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.872710:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.872712:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.872713:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.873255:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.873261:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873271:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.873274:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.873277:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873286:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873293:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873299:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873388:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.873398:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.873402:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873419:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8e00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.873422:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873430:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873441:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873448:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f391eb4b/0x72bfdc08f7eacecd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.873462:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.873464:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.873465:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782529366.874074:0:15665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782529366.874081:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874089:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1782529366.874092:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529366.874096:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874105:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874118:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874126:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874138:0:15665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782529366.874146:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529366.874149:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874155:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8c00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:0.0:1782529366.874159:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874165:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874175:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874183:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5bd68c3/0x72bfdc08f7eaced4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529366.874195:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.874200:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529366.874202:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1782529366.874437:0:15665:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1782529366.874522:0:15665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14276:x1869117117269888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 60355us (64467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529366.874594:0:15665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782529366.874648:0:14276:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14276:1869117117269888:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1782529366.874662:0:14276:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1782529366.874705:0:14276:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643965c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14276:1869117117270144:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782529366.874750:0:14276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529366.874788:0:14276:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646ec7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782529366.874813:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117270144 00000100:00100000:0.0:1782529366.874818:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117270144 00000100:00100000:0.0:1782529366.875917:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782529366.875931:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14276:x1869117117270144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1782529366.875969:0:14887:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1782529366.879873:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14274:x1869117117270016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17604us (17697us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782529366.880436:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782529366.880497:0:14274:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14274:1869117117270016:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782529366.880512:0:14274:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:0.0:1782529366.885511:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14276:x1869117117270144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9578us (10766us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782529366.885524:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782529366.886040:0:14276:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643965c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14276:1869117117270144:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1782529366.886056:0:14276:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1782529366.918754:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1782529367.687947:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529368.711014:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782529368.753176:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1782529368.753251:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1782529369.736498:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782529370.362723:0:7509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1782529370.362808:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1782529370.765651:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529371.784014:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782529371.962187:0:15913:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1782529372.231422:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529372.231443:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c643966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117270272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529372.231506:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529372.231575:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117270272 00000100:00100000:0.0:1782529372.231582:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117270272 00000100:00100000:0.0:1782529372.231626:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782529372.231634:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117270272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782529372.231665:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529372.231717:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117270272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529372.231725:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1782529372.231744:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529372.231773:0:3294:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782529372.231793:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c643966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117270272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529372.232034:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3296:1869117117270400:0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232066:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529372.232095:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117270912:0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232123:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529372.232142:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782529372.232147:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117270528:0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232170:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529372.232193:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117270912 00000100:00100000:0.0:1782529372.232197:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117270912 00000100:00100000:0.0:1782529372.232227:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782529372.232246:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117270912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232280:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117270912:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529372.232286:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1782529372.232303:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782529372.232388:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f1d5f80 x1869117117270912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529372.232400:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117270912:0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232421:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117270656:0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232443:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529372.232466:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529372.232471:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117270784:0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232490:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529372.232511:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117270656 00000100:00100000:0.0:1782529372.232515:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117270656 00000100:00100000:0.0:1782529372.232534:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117270784 00000100:00100000:0.0:1782529372.232537:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117270784 00000100:00100000:0.0:1782529372.232556:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782529372.232563:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117270656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232595:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117270656:12345-0@lo:400:kworker.0 Request processed in 33us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529372.232601:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782529372.232612:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782529372.232618:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117270784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529372.232641:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117270784:12345-0@lo:400:kworker.0 Request processed in 23us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529372.232656:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1782529372.232674:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782529372.232691:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f1d4380 x1869117117270784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529372.232711:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117270784:0@lo:400:kworker.0 00010000:00080000:0.0:1782529372.232722:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99c67f1d6300 x1869117117270656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782529388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782529372.232729:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117270656:0@lo:400:kworker.0 00000100:00100000:3.0:1782529372.232813:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117270400 00000100:00100000:3.0:1782529372.232818:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117270400 00000100:00100000:3.0:1782529372.232881:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782529372.232888:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6657c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3296:x1869117117270400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529372.232926:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6657c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3296:x1869117117270400:12345-0@lo:400:kworker.0 Request processed in 39us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529372.232942:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782529372.232977:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3296:1869117117270400:0@lo:400:kworker.0 00000100:00100000:2.0:1782529372.233138:0:14886:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117270528 00000100:00100000:2.0:1782529372.233143:0:14886:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117270528 00000100:00100000:2.0:1782529372.233179:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782529372.233191:0:14886:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117270528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529372.233228:0:14886:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117270528:12345-0@lo:400:kworker.0 Request processed in 38us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529372.233234:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782529372.233251:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529372.233350:0:3296:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1782529372.233364:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117270528:0@lo:400:kworker.0 00000100:00100000:1.0:1782529372.237293:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782529372.237330:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117271040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782529372.237393:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529372.237440:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117271040 00000100:00100000:1.0:1782529372.237447:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117271040 00000100:00100000:1.0:1782529372.237490:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529372.237498:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117271040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782529372.237532:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529372.237574:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117271040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529372.237581:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782529372.237625:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117271040:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782529372.813760:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782529373.127725:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782529373.837906:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529374.300824:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.300946:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108887808 00000100:00100000:0.0:1782529374.300957:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108887808 00000100:00100000:0.0:1782529374.301003:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:0.0:1782529374.301010:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c658261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2340:x1869117108887808:12345-192.168.202.50@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782529374.301038:0:14245:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 923e5c48-29dc-4396-9e3f-0290facfca89@192.168.202.50@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1782529374.301073:0:14245:0:(genops.c:1406:class_connect()) connect: client 923e5c48-29dc-4396-9e3f-0290facfca89, cookie 0x72bfdc08f7eacedb 00000100:00080000:0.0:1782529374.301215:0:14245:0:(import.c:65:import_set_state_nolock()) ffff99c542129800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782529374.301295:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c658261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+5:2340:x1869117108887808:12345-192.168.202.50@tcp:250:mount.lustre.0 Request processed in 284us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529374.301304:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:1.0:1782529374.305717:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.305813:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108887936 00000100:00100000:0.0:1782529374.305822:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108887936 00000100:00100000:0.0:1782529374.305920:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:0.0:1782529374.305930:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c658261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+5:13729:x1869117108887936:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782529374.305949:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529374.305977:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c67a1a9c00/0x72bfdc08f7eacee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae172 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529374.306007:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c67a1a9c00/0x72bfdc08f7eacee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae172 expref: 6 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529374.306018:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c67a1a9c00/0x72bfdc08f7eacee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae172 expref: 6 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529374.306027:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9c00, rc 0) 00000100:00100000:0.0:1782529374.306076:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c658261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+6:13729:x1869117108887936:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 148us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529374.306082:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:1.0:1782529374.318518:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529374.318610:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108888064 00000100:00100000:3.0:1782529374.318620:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108888064 00000100:00100000:3.0:1782529374.318685:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:3.0:1782529374.318695:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c658260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+6:13729:x1869117108888064:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782529374.318984:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c658260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+6:13729:x1869117108888064:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 290us (474us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782529374.318993:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:1.0:1782529374.327613:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529374.327719:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108888192 00000100:00100000:2.0:1782529374.327730:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108888192 00000100:00100000:2.0:1782529374.327785:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:2.0:1782529374.327795:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+6:13729:x1869117108888192:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782529374.327812:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529374.327829:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d01200/0x72bfdc08f7eacee9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae179 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.327891:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d01200/0x72bfdc08f7eacee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae179 expref: 7 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.327902:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d01200/0x72bfdc08f7eacee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae179 expref: 7 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.327911:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01200, rc 0) 00000100:00100000:2.0:1782529374.327969:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+7:13729:x1869117108888192:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 175us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529374.327976:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:1.0:1782529374.331712:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.331802:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108888320 00000100:00100000:0.0:1782529374.331812:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108888320 00000100:00100000:0.0:1782529374.331903:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:0.0:1782529374.331913:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+7:13729:x1869117108888320:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782529374.332179:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+8:13729:x1869117108888320:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 267us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529374.332187:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:1.0:1782529374.350696:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529374.350776:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108888448 00000100:00100000:3.0:1782529374.350786:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108888448 00000100:00100000:3.0:1782529374.350878:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:3.0:1782529374.350888:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+8:13729:x1869117108888448:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782529374.351154:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+8:13729:x1869117108888448:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 267us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529374.351162:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:1.0:1782529374.356974:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529374.357167:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108888576 00000100:00100000:2.0:1782529374.357177:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108888576 00000100:00100000:2.0:1782529374.357263:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:2.0:1782529374.357273:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+8:13747:x1869117108888576:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782529374.357622:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+8:13747:x1869117108888576:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 349us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529374.357630:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:1.0:1782529374.400300:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.400420:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108888704 00000100:00100000:0.0:1782529374.400438:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108888704 00000100:00100000:0.0:1782529374.400516:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:0.0:1782529374.400528:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+8:13747:x1869117108888704:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782529374.400882:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+8:13747:x1869117108888704:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 306us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529374.400891:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:1.0:1782529374.415152:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529374.423712:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108888832 00000100:00100000:3.0:1782529374.423735:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108888832 00000100:00100000:3.0:1782529374.423821:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:3.0:1782529374.423862:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+8:13729:x1869117108888832:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782529374.423896:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529374.425611:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae1a3 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.425663:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1a3 expref: 9 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.425687:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d00c00/0x72bfdc08f7eacef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1a3 expref: 9 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.425697:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00c00, rc 0) 00000100:00100000:2.0:1782529374.425783:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+9:13729:x1869117108888832:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 1952us (10645us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529374.425792:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:1.0:1782529374.431749:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529374.431970:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108888960 00000100:00100000:2.0:1782529374.431980:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108888960 00000100:00100000:2.0:1782529374.432036:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:2.0:1782529374.432046:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+9:13729:x1869117108888960:12345-192.168.202.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782529374.432076:0:14245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782529374.432103:0:14245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782529374.432108:0:14245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782529374.432110:0:14245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782529374.432113:0:14245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1782529374.443275:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+9:13729:x1869117108888960:12345-192.168.202.50@tcp:256:mount.lustre.0 Request processed in 11220us (11527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529374.443301:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:1.0:1782529374.448076:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529374.448527:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108889088 00000100:00100000:2.0:1782529374.448536:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108889088 00000100:00100000:2.0:1782529374.448584:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:2.0:1782529374.448592:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+9:13729:x1869117108889088:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782529374.448607:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529374.448625:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae1aa expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.448654:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 10 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.448666:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 10 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529374.448706:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00000, rc 0) 00000100:00100000:2.0:1782529374.448766:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+10:13729:x1869117108889088:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 175us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529374.448773:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:1.0:1782529374.452818:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.452997:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108889216 00000100:00100000:0.0:1782529374.453016:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108889216 00000100:00100000:0.0:1782529374.453111:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:0.0:1782529374.453123:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+10:13729:x1869117108889216:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782529374.453874:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+10:13729:x1869117108889216:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 710us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529374.453886:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:1.0:1782529374.458658:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529374.458821:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108889344 00000100:00100000:2.0:1782529374.458873:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108889344 00000100:00100000:2.0:1782529374.458949:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:2.0:1782529374.458961:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+10:13729:x1869117108889344:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782529374.459366:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+10:13729:x1869117108889344:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 405us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529374.459387:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:1.0:1782529374.469720:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.470687:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108889472 00000100:00100000:0.0:1782529374.470704:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108889472 00000100:00100000:0.0:1782529374.470789:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:0.0:1782529374.470801:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f5f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+10:13751:x1869117108889472:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782529374.472373:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f5f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+10:13751:x1869117108889472:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 1560us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529374.472388:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:3.0:1782529374.475494:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529374.475670:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108889600 00000100:00100000:1.0:1782529374.475695:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108889600 00000100:00100000:1.0:1782529374.475765:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:1.0:1782529374.475778:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+10:13751:x1869117108889600:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782529374.476138:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+10:13751:x1869117108889600:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 362us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529374.476149:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:1.0:1782529374.486185:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.486411:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108889728 00000100:00100000:0.0:1782529374.486426:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108889728 00000100:00100000:0.0:1782529374.486491:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:0.0:1782529374.486502:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2340:x1869117108889728:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782529374.486540:0:14253:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 4b437120-96ff-49ee-9e7b-527157856ce3@192.168.202.50@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1782529374.486612:0:14253:0:(genops.c:1406:class_connect()) connect: client 4b437120-96ff-49ee-9e7b-527157856ce3, cookie 0x72bfdc08f7eacefe 00000004:00100000:0.0:1782529374.486652:0:14253:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782529374.486660:0:14253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1782529374.593586:0:14253:0:(import.c:65:import_set_state_nolock()) ffff99c541130000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782529374.593790:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+6:2340:x1869117108889728:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 107286us (107619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529374.593804:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1782529374.597754:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529374.598392:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.601615:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108889984 00000100:00100000:0.0:1782529374.601637:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108889984 00000100:00100000:0.0:1782529374.601767:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108889856 00000100:00100000:0.0:1782529374.601772:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108889856 00000100:00100000:0.0:1782529374.601826:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1782529374.601864:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+7:13729:x1869117108889984:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782529374.601939:0:15471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782529374.602051:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+7:13729:x1869117108889984:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 214us (4311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529374.602059:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1782529374.602085:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:0.0:1782529374.602092:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+6:0:x1869117108889856:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782529374.602105:0:15471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782529374.602127:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+6:0:x1869117108889856:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 36us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529374.602133:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00080000:2.0:1782529374.607748:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529374.609950:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.613643:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108890112 00000100:00100000:0.0:1782529374.613666:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108890112 00000100:00100000:1.0:1782529374.616756:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:1.0:1782529374.616777:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+6:13729:x1869117108890112:12345-192.168.202.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782529374.616953:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+6:13729:x1869117108890112:12345-192.168.202.50@tcp:40:mount.lustre.0 Request processed in 181us (7017us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529374.616962:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1782529374.625080:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.625192:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529374.625231:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529374.625390:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108890240 00000100:00100000:3.0:1782529374.625404:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108890240 00000100:00100000:3.0:1782529374.625473:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108890368 00000100:00100000:3.0:1782529374.625477:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108890368 00000100:00100000:3.0:1782529374.625540:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:3.0:1782529374.625551:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1869117108890240:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782529374.625634:0:14887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 4b437120-96ff-49ee-9e7b-527157856ce3@192.168.202.50@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1782529374.625723:0:14887:0:(genops.c:1406:class_connect()) connect: client 4b437120-96ff-49ee-9e7b-527157856ce3, cookie 0x72bfdc08f7eacf05 00002000:00100000:3.0:1782529374.625740:0:14887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4b437120-96ff-49ee-9e7b-527157856ce3/ffff99c541135000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782529374.625773:0:14887:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782529374.626293:0:14887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782529374.626336:0:14887:0:(import.c:65:import_set_state_nolock()) ffff99c541137800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782529374.626465:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+6:2340:x1869117108890240:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 913us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529374.626475:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:3.0:1782529374.626502:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1782529374.626534:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1869117108890368:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782529374.626559:0:14887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 4b437120-96ff-49ee-9e7b-527157856ce3@192.168.202.50@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1782529374.626602:0:14887:0:(genops.c:1406:class_connect()) connect: client 4b437120-96ff-49ee-9e7b-527157856ce3, cookie 0x72bfdc08f7eacf0c 00002000:00100000:3.0:1782529374.626655:0:14887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4b437120-96ff-49ee-9e7b-527157856ce3/ffff99c541133800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782529374.626713:0:14887:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782529374.627081:0:14887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782529374.627104:0:14887:0:(import.c:65:import_set_state_nolock()) ffff99c541131800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782529374.627168:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+6:2340:x1869117108890368:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 641us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529374.627175:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1782529374.633090:0:14254:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108890496 00000100:00100000:2.0:1782529374.633113:0:14254:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108890496 00000100:00100000:2.0:1782529374.633275:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1782529374.633298:0:14254:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b437120-96ff-49ee-9e7b-527157856ce3+6:13729:x1869117108890496:12345-192.168.202.50@tcp:33:mount.lustre.0 00000004:00080000:0.0:1782529374.641775:0:14254:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8375us 00000004:00200000:3.0:1782529374.663945:0:14254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782529374.664204:0:14254:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b437120-96ff-49ee-9e7b-527157856ce3+6:13729:x1869117108890496:12345-192.168.202.50@tcp:33:mount.lustre.0 Request processed in 30908us (39128us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529374.664239:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00010000:00010000:2.0:1782529374.855255:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529374.913037:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529374.913205:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108890624 00000100:00100000:1.0:1782529374.913220:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108890624 00000100:00100000:1.0:1782529374.913309:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:1.0:1782529374.913321:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+6:13772:x1869117108890624:12345-192.168.202.50@tcp:101:mkdir.0 00010000:00010000:1.0:1782529374.913350:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529374.913386:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571000/0x72bfdc08f7eacf13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae1d4 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529374.913486:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570000/0x72bfdc08f7eacf1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529374.913522:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570000/0x72bfdc08f7eacf1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529374.913538:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570000/0x72bfdc08f7eacf1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529374.913891:0:14252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782529374.913897:0:14252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782529374.914003:0:14252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570000/0x72bfdc08f7eacf1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529374.914040:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571000/0x72bfdc08f7eacf13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1d4 expref: 8 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529374.914061:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570000/0x72bfdc08f7eacf1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1d4 expref: 7 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529374.914071:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c659557000) 00010000:00010000:1.0:1782529374.914074:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782529374.914079:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c670570000, rc 0) 00000100:00100000:1.0:1782529374.914183:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+7:13772:x1869117108890624:12345-192.168.202.50@tcp:101:mkdir.0 Request processed in 863us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529374.914191:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000001:00100000:0.0:1782529375.390115:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b437120-96ff-49ee-9e7b-527157856ce3 00010000:00010000:0.0:1782529375.879084:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529376.903303:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529377.088950:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.089149:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108890752 00000100:00100000:1.0:1782529377.089164:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108890752 00000100:00100000:1.0:1782529377.089290:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1782529377.089305:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+7:13825:x1869117108890752:12345-192.168.202.50@tcp:41:lfs.0 00000004:00000024:1.0:1782529377.089371:0:14253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782529377.089517:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+7:13825:x1869117108890752:12345-192.168.202.50@tcp:41:lfs.0 Request processed in 214us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.089526:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00080000:2.0:1782529377.090801:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529377.095311:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.095726:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108890880 00000100:00100000:1.0:1782529377.095741:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108890880 00000100:00100000:1.0:1782529377.096165:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:1.0:1782529377.096179:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b437120-96ff-49ee-9e7b-527157856ce3+6:13825:x1869117108890880:12345-192.168.202.50@tcp:13:lfs.0 00002000:00000024:1.0:1782529377.096238:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529377.096363:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b437120-96ff-49ee-9e7b-527157856ce3+6:13825:x1869117108890880:12345-192.168.202.50@tcp:13:lfs.0 Request processed in 187us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.096372:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00080000:2.0:1782529377.102304:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529377.103109:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.103354:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108891008 00000100:00100000:1.0:1782529377.103369:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108891008 00000100:00100000:1.0:1782529377.103516:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:1.0:1782529377.103528:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b437120-96ff-49ee-9e7b-527157856ce3+5:13825:x1869117108891008:12345-192.168.202.50@tcp:13:lfs.0 00002000:00000024:1.0:1782529377.103588:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529377.103717:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b437120-96ff-49ee-9e7b-527157856ce3+5:13825:x1869117108891008:12345-192.168.202.50@tcp:13:lfs.0 Request processed in 191us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.103726:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00080000:2.0:1782529377.113043:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529377.324458:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529377.324703:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108891136 00000100:00100000:2.0:1782529377.324717:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108891136 00000100:00100000:2.0:1782529377.324813:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 89 00000100:00100000:2.0:1782529377.324825:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+10:13858:x1869117108891136:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782529377.324909:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529377.324934:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c647d00e00/0x72bfdc08f7eacf21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae1db expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529377.324969:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d00e00/0x72bfdc08f7eacf21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1db expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529377.324983:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c647d00e00/0x72bfdc08f7eacf21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1db expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529377.324995:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00e00, rc 0) 00000100:00100000:2.0:1782529377.325065:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+11:13858:x1869117108891136:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 242us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529377.325092:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 89 00000100:00100000:3.0:1782529377.340441:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529377.340620:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108891264 00000100:00100000:0.0:1782529377.340634:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108891264 00000100:00100000:0.0:1782529377.340718:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:0.0:1782529377.340729:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+11:13858:x1869117108891264:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782529377.342545:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+11:13858:x1869117108891264:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 1802us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.342560:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:0.0:1782529377.350139:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.350245:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108891392 00000100:00100000:1.0:1782529377.350259:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108891392 00000100:00100000:1.0:1782529377.350326:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:1.0:1782529377.350338:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+11:13858:x1869117108891392:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782529377.350743:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+11:13858:x1869117108891392:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 405us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.350753:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:2.0:1782529377.352079:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3295:1869117117271296:0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.352079:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117271168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529377.352174:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117271552:0@lo:400:kworker.0 00000100:00100000:1.0:1782529377.352383:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117271424:0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.360642:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529377.360769:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117271680:0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.360862:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529377.360994:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117271680 00000100:00100000:0.0:1782529377.361003:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117271680 00000100:00100000:0.0:1782529377.361062:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782529377.361071:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117271680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.361129:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869117117271680:12345-0@lo:400:kworker.0 Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.361136:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782529377.361188:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869117117271680:0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.361242:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117271168 00000100:00100000:0.0:1782529377.361246:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117271168 00000100:00100000:0.0:1782529377.361280:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782529377.361285:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117271168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782529377.361302:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529377.361338:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117271168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.361343:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782529377.361375:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117271168:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782529377.361441:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529377.361702:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529377.361735:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108891520 00000100:00100000:0.0:1782529377.361739:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108891520 00000100:00100000:0.0:1782529377.361771:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:0.0:1782529377.361777:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+11:13864:x1869117108891520:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782529377.362862:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+11:13864:x1869117108891520:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 1049us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.363109:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:2.0:1782529377.366105:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529377.366206:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117271808:0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.366240:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117271296 00000100:00100000:0.0:1782529377.366251:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117271296 00000100:00100000:2.0:1782529377.366287:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529377.366322:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117271808 00000100:00100000:2.0:1782529377.366327:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117271808 00000100:00100000:2.0:1782529377.366389:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782529377.366399:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117271808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.366450:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782529377.366461:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c646bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3295:x1869117117271296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529377.366468:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117271808:12345-0@lo:400:kworker.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529377.366477:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1782529377.366512:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529377.366512:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c646bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3295:x1869117117271296:12345-0@lo:400:kworker.0 Request processed in 52us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.366522:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782529377.366553:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117271808:0@lo:400:kworker.0 00000100:00100000:2.0:1782529377.366590:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3295:1869117117271296:0@lo:400:kworker.0 00000100:00100000:3.0:1782529377.367330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529377.367385:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117272064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782529377.367421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529377.367462:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117272064 00000100:00100000:3.0:1782529377.367467:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117272064 00000100:00100000:3.0:1782529377.367510:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782529377.367517:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117272064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529377.367539:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529377.367576:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117272064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529377.367614:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782529377.367674:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117272064:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782529377.367894:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529377.368166:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117271552 00000100:00100000:0.0:1782529377.368172:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117271552 00000100:00100000:0.0:1782529377.368225:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782529377.368234:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117271552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.368292:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117271552:12345-0@lo:400:kworker.0 Request processed in 60us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.368299:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782529377.368418:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117271552:0@lo:400:kworker.0 00000100:00100000:1.0:1782529377.370049:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529377.370112:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117271936:0@lo:400:kworker.0 00000100:00100000:1.0:1782529377.370162:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529377.370360:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117271936 00000100:00100000:2.0:1782529377.370369:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117271936 00000100:00100000:2.0:1782529377.370451:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782529377.370459:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117271936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529377.370521:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1869117117271936:12345-0@lo:400:kworker.0 Request processed in 62us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529377.370529:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1782529377.370608:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782529377.370710:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1869117117271936:0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.370949:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117271424 00000100:00100000:0.0:1782529377.370954:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117271424 00000100:00100000:0.0:1782529377.370995:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782529377.371003:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117271424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529377.371076:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117271424:12345-0@lo:400:kworker.0 Request processed in 74us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.371083:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782529377.371317:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117271424:0@lo:400:kworker.0 00000100:00100000:3.0:1782529377.406954:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529377.407131:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108891648 00000100:00100000:0.0:1782529377.407144:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108891648 00000100:00100000:0.0:1782529377.409467:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00100000:0.0:1782529377.409500:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+11:13864:x1869117108891648:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782529377.409981:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+11:13864:x1869117108891648:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 494us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.409991:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00100000:2.0:1782529377.422537:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.423047:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108891776 00000100:00100000:1.0:1782529377.423061:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108891776 00000100:00100000:1.0:1782529377.423133:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:1.0:1782529377.423144:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+11:13858:x1869117108891776:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782529377.423167:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529377.423197:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c670571000/0x72bfdc08f7eacf28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae205 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529377.423237:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c670571000/0x72bfdc08f7eacf28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae205 expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529377.423251:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c670571000/0x72bfdc08f7eacf28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae205 expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529377.423272:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c670571000, rc 0) 00000100:00100000:1.0:1782529377.423457:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+12:13858:x1869117108891776:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 313us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.423466:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:3.0:1782529377.436136:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.436428:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108891904 00000100:00100000:1.0:1782529377.436442:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108891904 00000100:00100000:1.0:1782529377.436518:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:1.0:1782529377.436531:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+12:13858:x1869117108891904:12345-192.168.202.50@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782529377.436589:0:14244:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782529377.436611:0:14244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782529377.436616:0:14244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782529377.436619:0:14244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782529377.436622:0:14244:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1782529377.438696:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+12:13858:x1869117108891904:12345-192.168.202.50@tcp:256:mount.lustre.0 Request processed in 2155us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.438713:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:2.0:1782529377.444278:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529377.444390:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108892032 00000100:00100000:0.0:1782529377.444404:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108892032 00000100:00100000:0.0:1782529377.444478:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 97 00000100:00100000:0.0:1782529377.444491:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+12:13858:x1869117108892032:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782529377.444514:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529377.444538:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae20c expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.444579:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 13 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.444594:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 13 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.444605:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9800, rc 0) 00000100:00100000:0.0:1782529377.444694:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:13858:x1869117108892032:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 206us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.444723:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 97 00000100:00100000:3.0:1782529377.451959:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.452237:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108892160 00000100:00100000:1.0:1782529377.452250:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108892160 00000100:00100000:1.0:1782529377.452321:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 98 00000100:00100000:1.0:1782529377.452332:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+13:13858:x1869117108892160:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782529377.452690:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+13:13858:x1869117108892160:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 358us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.452699:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 98 00000100:00100000:3.0:1782529377.454467:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529377.454570:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108892288 00000100:00100000:0.0:1782529377.454582:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108892288 00000100:00100000:0.0:1782529377.454660:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:0.0:1782529377.454671:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:13858:x1869117108892288:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782529377.455111:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:13858:x1869117108892288:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 439us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.455120:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:2.0:1782529377.460028:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529377.462377:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108892416 00000100:00100000:0.0:1782529377.462400:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108892416 00000100:00100000:0.0:1782529377.462501:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:0.0:1782529377.462512:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+13:13869:x1869117108892416:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782529377.464748:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+13:13869:x1869117108892416:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 2221us (4720us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.464767:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:3.0:1782529377.484682:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.485971:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108892544 00000100:00100000:1.0:1782529377.486000:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108892544 00000100:00100000:1.0:1782529377.486098:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:1.0:1782529377.486112:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+13:13869:x1869117108892544:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782529377.486467:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+13:13869:x1869117108892544:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 356us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.486477:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:3.0:1782529377.508583:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529377.508635:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529377.508797:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529377.508882:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.510346:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108893184 00000100:00100000:1.0:1782529377.510364:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108893184 00000100:00100000:1.0:1782529377.510450:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108893312 00000100:00100000:1.0:1782529377.510454:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108893312 00000100:00100000:1.0:1782529377.510506:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1782529377.510517:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+6:2343:x1869117108893184:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529377.510627:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+6:2343:x1869117108893184:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 111us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.510635:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1782529377.511543:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1782529377.511561:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b437120-96ff-49ee-9e7b-527157856ce3+5:2344:x1869117108893312:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529377.511616:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b437120-96ff-49ee-9e7b-527157856ce3+5:2344:x1869117108893312:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 63us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529377.511623:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:0.0:1782529377.515914:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108892672 00000100:00100000:0.0:1782529377.515937:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108892672 00000100:00100000:1.0:1782529377.517050:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108893056 00000100:00100000:1.0:1782529377.517062:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108893056 00000100:00100000:1.0:1782529377.517140:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:1.0:1782529377.517153:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+7:2344:x1869117108893056:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529377.517282:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+7:2344:x1869117108893056:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 130us (8644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.517291:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:1.0:1782529377.517314:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1782529377.517319:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2340:x1869117108892672:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782529377.517348:0:15471:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d@192.168.202.50@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1782529377.517399:0:15471:0:(genops.c:1406:class_connect()) connect: client 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d, cookie 0x72bfdc08f7eacf36 00000004:00100000:1.0:1782529377.517441:0:15471:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782529377.517610:0:15471:0:(import.c:65:import_set_state_nolock()) ffff99c6795c9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529377.517755:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2340:x1869117108892672:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 330us (9085us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.517763:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1782529377.526559:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529377.526628:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.526759:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108892800 00000100:00100000:1.0:1782529377.526773:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108892800 00000100:00100000:1.0:1782529377.526912:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108892928 00000100:00100000:1.0:1782529377.526916:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108892928 00000100:00100000:1.0:1782529377.526942:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1782529377.526973:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+7:0:x1869117108892800:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782529377.527030:0:15471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782529377.527251:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+7:0:x1869117108892800:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 280us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.527260:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1782529377.527283:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1782529377.527290:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:13858:x1869117108892928:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782529377.527303:0:15471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782529377.527327:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:13858:x1869117108892928:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 37us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.527334:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00080000:3.0:1782529377.529485:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529377.532317:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529377.532450:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108893440 00000100:00100000:1.0:1782529377.532464:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108893440 00000100:00100000:1.0:1782529377.532541:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:1.0:1782529377.532553:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:13858:x1869117108893440:12345-192.168.202.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782529377.532682:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:13858:x1869117108893440:12345-192.168.202.50@tcp:40:mount.lustre.0 Request processed in 130us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.532691:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1782529377.535870:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529377.536791:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108893568 00000100:00100000:0.0:1782529377.536807:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108893568 00000100:00100000:0.0:1782529377.536914:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1782529377.536924:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1869117108893568:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782529377.536964:0:14888:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d@192.168.202.50@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:0.0:1782529377.537016:0:14888:0:(genops.c:1406:class_connect()) connect: client 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d, cookie 0x72bfdc08f7eacf3d 00002000:00100000:0.0:1782529377.537031:0:14888:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d/ffff99c65f4c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782529377.537062:0:14888:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782529377.537226:0:14888:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782529377.537274:0:14888:0:(import.c:65:import_set_state_nolock()) ffff99c646095000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782529377.537376:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2340:x1869117108893568:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 451us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.537385:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:3.0:1782529377.551266:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529377.551339:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529377.551526:0:14255:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108893824 00000100:00100000:2.0:1782529377.551539:0:14255:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108893824 00000100:00100000:2.0:1782529377.551601:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:2.0:1782529377.551611:0:14255:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:13858:x1869117108893824:12345-192.168.202.50@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782529377.552095:0:14255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782529377.552264:0:14255:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:13858:x1869117108893824:12345-192.168.202.50@tcp:33:mount.lustre.0 Request processed in 652us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529377.552274:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:1.0:1782529377.552480:0:15665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108893696 00000100:00100000:1.0:1782529377.552486:0:15665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108893696 00000100:00100000:1.0:1782529377.552525:0:15665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1782529377.552532:0:15665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1869117108893696:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782529377.552567:0:15665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d@192.168.202.50@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1782529377.552604:0:15665:0:(genops.c:1406:class_connect()) connect: client 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d, cookie 0x72bfdc08f7eacf44 00002000:00100000:1.0:1782529377.552626:0:15665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d/ffff99c645ab1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113663 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782529377.552640:0:15665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782529377.552911:0:15665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782529377.552946:0:15665:0:(import.c:65:import_set_state_nolock()) ffff99c645ab6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782529377.552984:0:15665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2340:x1869117108893696:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 451us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529377.552991:0:15665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:2.0:1782529377.710960:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529377.711064:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108893952 00000100:00100000:0.0:1782529377.711076:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108893952 00000100:00100000:0.0:1782529377.711140:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:0.0:1782529377.711149:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:13890:x1869117108893952:12345-192.168.202.50@tcp:101:mkdir.0 00010000:00010000:0.0:1782529377.711176:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529377.711207:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8000/0x72bfdc08f7eacf4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae236 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.711279:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.711291:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.711302:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529377.711520:0:14252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782529377.711524:0:14252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529377.711584:0:14252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.711612:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8000/0x72bfdc08f7eacf4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 8 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.711642:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 7 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529377.711661:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c659557000) 00010000:00010000:0.0:1782529377.711665:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782529377.711670:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a8600, rc 0) 00000100:00100000:0.0:1782529377.711747:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+7:13890:x1869117108893952:12345-192.168.202.50@tcp:101:mkdir.0 Request processed in 597us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529377.711753:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00010000:00010000:0.0:1782529377.927566:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529378.955059:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782529378.970137:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d 00000001:00100000:0.0:1782529378.970158:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b437120-96ff-49ee-9e7b-527157856ce3 00000001:00100000:3.0:1782529379.940572:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d 00000001:00100000:3.0:1782529379.940675:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4b437120-96ff-49ee-9e7b-527157856ce3 00010000:00010000:0.0:1782529379.974968:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782529380.454373:0:16120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1782529380.470484:0:7509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d 00010000:00010000:3.0:1782529381.000751:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529382.023031:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529382.471350:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117272576:0@lo:400:kworker.0 00000100:00100000:3.0:1782529382.471446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529382.471516:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529382.471521:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117272448:0@lo:400:kworker.0 00000100:00100000:3.0:1782529382.471544:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529382.471589:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117272448 00000100:00100000:3.0:1782529382.471599:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117272448 00000100:00100000:3.0:1782529382.471679:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782529382.471691:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117272448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529382.471758:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117272448:12345-0@lo:400:kworker.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529382.471765:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1782529382.471788:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782529382.471824:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117272448:0@lo:400:kworker.0 00000100:00100000:1.0:1782529382.472111:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117272576 00000100:00100000:1.0:1782529382.472115:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117272576 00000100:00100000:1.0:1782529382.472147:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782529382.472153:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117272576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529382.472190:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1869117117272576:12345-0@lo:400:kworker.0 Request processed in 38us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529382.472196:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782529382.472266:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117272192:0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.472305:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529382.472336:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117272704:0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.472355:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529382.472373:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782529382.472378:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117272320:0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.472396:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529382.472406:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f19a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117272832:0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.472429:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529382.472454:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117272960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529382.472476:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529382.472490:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529382.472494:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117273088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529382.472530:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529382.472551:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117272704 00000100:00100000:2.0:1782529382.472554:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117272704 00000100:00100000:2.0:1782529382.472581:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117272832 00000100:00100000:2.0:1782529382.472584:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117272832 00000100:00100000:2.0:1782529382.472599:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782529382.472605:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117272704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.472663:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869117117272704:12345-0@lo:400:kworker.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529382.472670:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782529382.472680:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782529382.472686:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117272832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.472706:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117272832:12345-0@lo:400:kworker.0 Request processed in 21us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529382.472712:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782529382.472738:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f19a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117272832:0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.472748:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1869117117272704:0@lo:400:kworker.0 00000100:00100000:1.0:1782529382.472869:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117272192 00000100:00100000:1.0:1782529382.472873:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117272192 00000100:00100000:1.0:1782529382.472900:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782529382.472906:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3294:x1869117117272192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529382.472944:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3294:x1869117117272192:12345-0@lo:400:kworker.0 Request processed in 38us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529382.472950:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782529382.472977:0:15665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117272320 00000100:00100000:1.0:1782529382.472979:0:15665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117272320 00000100:00100000:1.0:1782529382.473000:0:15665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782529382.473005:0:15665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117272320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782529382.473029:0:15665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117272320:12345-0@lo:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529382.473042:0:15665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782529382.473350:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117272320:0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.473359:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117272192:0@lo:400:kworker.0 00000100:00100000:3.0:1782529382.477045:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117272960 00000100:00100000:3.0:1782529382.477067:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117272960 00000100:00100000:3.0:1782529382.477135:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117273088 00000100:00100000:3.0:1782529382.477139:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117273088 00000100:00100000:3.0:1782529382.477161:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782529382.477172:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117272960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529382.477239:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529382.477372:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117272960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (4893us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529382.477380:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782529382.477421:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782529382.477429:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117273088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782529382.477455:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529382.477489:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117273088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (4957us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529382.477495:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1782529382.477525:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782529382.477532:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782529382.477584:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1869117117272576:0@lo:400:kworker.0 00000100:00100000:2.0:1782529382.478326:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117273088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529382.478350:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117272960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529382.742936:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529382.742980:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529382.743004:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529382.743030:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529382.743052:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529382.743069:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529382.743118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529382.743158:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108894336 00000100:00100000:0.0:1782529382.743172:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108894336 00000100:00100000:0.0:1782529382.743264:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108894848 00000100:00100000:0.0:1782529382.743280:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108894848 00000100:00100000:0.0:1782529382.743301:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108894464 00000100:00100000:0.0:1782529382.743304:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108894464 00000100:00100000:0.0:1782529382.743314:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108894720 00000100:00100000:0.0:1782529382.743316:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108894720 00000100:00100000:0.0:1782529382.743337:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1782529382.743349:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+5:2343:x1869117108894336:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529382.743565:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+5:2343:x1869117108894336:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 217us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529382.743574:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1782529382.743603:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1782529382.743619:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2343:x1869117108894848:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529382.743648:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2343:x1869117108894848:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 39us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529382.743654:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1782529382.743664:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:0.0:1782529382.743670:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+5:2344:x1869117108894464:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529382.743692:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+5:2344:x1869117108894464:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529382.743698:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:0.0:1782529382.743708:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:0.0:1782529382.743713:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2344:x1869117108894720:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529382.743734:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2344:x1869117108894720:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 21us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529382.743740:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:0.0:1782529382.743772:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108894592 00000100:00100000:0.0:1782529382.743776:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108894592 00000100:00100000:0.0:1782529382.743809:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108894208 00000100:00100000:0.0:1782529382.743812:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108894208 00000100:00100000:0.0:1782529382.743862:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:0.0:1782529382.743870:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2343:x1869117108894592:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529382.743900:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2343:x1869117108894592:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 32us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529382.743907:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:0.0:1782529382.743918:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:0.0:1782529382.743924:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+6:2344:x1869117108894208:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529382.743945:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+6:2344:x1869117108894208:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 22us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529382.743951:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00080000:0.0:1782529382.743978:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782529382.743983:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782529382.743985:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529382.744255:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108894080 00000100:00100000:2.0:1782529382.744261:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108894080 00000100:00100000:2.0:1782529382.744303:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 103 00000100:00100000:2.0:1782529382.744318:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:2343:x1869117108894080:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529382.744353:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:2343:x1869117108894080:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 37us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529382.744360:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 103 00010000:00010000:2.0:1782529383.048538:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782529383.369739:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782529384.087618:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782529384.194746:0:16269:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3acb4380 20000000:00000080:1.0:1782529384.194765:0:16269:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99c668a55000 uarg=0000000000000000 20000000:01000000:1.0:1782529384.194806:0:16269:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782529384.194812:0:16269:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782529384.194817:0:16269:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782529384.209094:0:16270:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1782529384.209431:0:16269:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1782529384.223315:0:16269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782529384.225429:0:16269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225452:0:16269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 18 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225460:0:16269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225466:0:16269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 18 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225476:0:16269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225483:0:16269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 12 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225492:0:16269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225550:0:16269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 12 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225580:0:16269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 12 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529384.225607:0:16269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273216:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529384.225719:0:16269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225728:0:16269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 12 pid: 14244 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529384.225736:0:16269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273344:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529384.225767:0:16269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 18 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.225776:0:16269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 18 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529384.225786:0:16269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273472:0@lo:104: 00000100:00100000:2.0:1782529384.225827:0:16269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529384.225893:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117273472 00000100:00100000:2.0:1782529384.225902:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117273472 00000100:00100000:2.0:1782529384.226420:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782529384.226432:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:16269:x1869117117273472:12345-0@lo:104: 00010000:00010000:2.0:1782529384.226446:0:14234:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.226509:0:14234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529384.226524:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:16269:x1869117117273472:12345-0@lo:104: Request processed in 95us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529384.226531:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1782529384.226557:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782529384.226563:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.226571:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01800 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:2.0:1782529384.226575:0:14239:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.226584:0:14239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782529384.226592:0:14239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782529384.226611:0:14239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782529384.226639:0:14239:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.226645:0:14239:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782529384.226665:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.226672:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c647d01800/0x72bfdc08f7eacd06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacd0d expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.226684:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529384.226686:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782529384.226688:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529384.226708:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117273600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782529384.226746:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782529384.226801:0:16269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.226811:0:16269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 18 pid: 14246 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529384.226821:0:16269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f754a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273728:0@lo:104: 00000100:00100000:2.0:1782529384.226875:0:16269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529384.226894:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117273728 00000100:00100000:2.0:1782529384.226899:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117273728 00000100:00100000:2.0:1782529384.226920:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782529384.226926:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:16269:x1869117117273728:12345-0@lo:104: 00000100:00100000:1.0:1782529384.227071:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117273600 00000100:00100000:1.0:1782529384.227075:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117273600 00010000:00010000:1.0:1782529384.227094:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 19 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529384.227114:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782529384.227119:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3294:x1869117117273600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782529384.227129:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529384.227133:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 19 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.227141:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 19 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.227155:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529384.227190:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3294:x1869117117273600:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529384.227197:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782529384.227248:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117273600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782529384.227350:0:14234:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.227399:0:14234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782529384.227405:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:16269:x1869117117273728:12345-0@lo:104: Request processed in 479us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529384.227411:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782529384.227449:0:16269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 18 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529384.227458:0:16269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 18 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529384.227469:0:16269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273856:0@lo:104: 00000100:00100000:2.0:1782529384.227561:0:16269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529384.227588:0:16269:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c64803bcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1782529384.227613:0:16269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c640031400/0x72bfdc08f7eacd0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eacd06 expref: 18 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529384.227625:0:16269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f1d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273472:0@lo:104: 00000100:00100000:2.0:1782529384.227633:0:16269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f754a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273728:0@lo:104: 00010000:00010000:1.0:1782529384.227761:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782529384.227767:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.227785:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c640031c00 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:1.0:1782529384.227789:0:14240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.227797:0:14240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782529384.227803:0:14240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529384.227807:0:14240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782529384.227861:0:14240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.227868:0:14240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782529384.227887:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.227893:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c640031c00/0x72bfdc08f7eacc96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc9d expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.227902:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529384.227904:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782529384.227905:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529384.227921:0:14235:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782529384.228038:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782529384.228050:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117273984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529384.228086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529384.228305:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117273856 00000100:00100000:0.0:1782529384.228311:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117273856 00000100:00100000:0.0:1782529384.228352:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782529384.228359:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c6795b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:16269:x1869117117273856:12345-0@lo:104: 00010000:00010000:0.0:1782529384.228368:0:14235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228422:0:14235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782529384.228428:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c6795b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+3:16269:x1869117117273856:12345-0@lo:104: Request processed in 70us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529384.228434:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1782529384.228474:0:14239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782529384.228479:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228485:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c6587c7400 already unused, calling callback (ffffffffc1d2cc20) 10000000:00010000:0.0:1782529384.228489:0:14239:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228575:0:14239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782529384.228583:0:14239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529384.228588:0:14239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782529384.228622:0:14239:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228628:0:14239:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782529384.228651:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228658:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99c6587c7400/0x72bfdc08f7eacc49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bfdc08f7eacc50 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228684:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529384.228686:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782529384.228687:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529384.228699:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3296:1869117117274112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529384.228728:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529384.228769:0:14237:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117273984 00000100:00100000:0.0:1782529384.228774:0:14237:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117273984 00010000:00010000:0.0:1782529384.228791:0:14237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 18 pid: 14246 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529384.228806:0:14237:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117274112 00000100:00100000:0.0:1782529384.228809:0:14237:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117274112 00010000:00010000:0.0:1782529384.228818:0:14237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 19 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529384.228829:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782529384.228867:0:14237:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3294:x1869117117273984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782529384.228877:0:14237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529384.228881:0:14237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 19 pid: 14246 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228890:0:14237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 19 pid: 14246 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228901:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c6587c6400/0x72bfdc08f7eacc9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eacc96 expref: 19 pid: 14246 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.228912:0:14237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529384.229051:0:14238:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1782529384.229060:0:14238:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1782529384.229146:0:14236:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1782529384.229155:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782529384.229162:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:3296:x1869117117274112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782529384.229178:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529384.229182:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 18 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.229190:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 18 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529384.229201:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529384.229564:0:16269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c6587c7a00/0x72bfdc08f7eacc50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bfdc08f7eacc49 expref: 18 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529384.229576:0:16269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273856:0@lo:104: 00000100:00100000:1.0:1782529384.229732:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:3296:x1869117117274112:12345-0@lo:103:ldlm_bl.0 Request processed in 569us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529384.229740:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782529384.229943:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3296:1869117117274112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782529384.230126:0:14237:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:3294:x1869117117273984:12345-0@lo:103:ldlm_bl.0 Request processed in 1259us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529384.230133:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782529384.230243:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3294:1869117117273984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782529384.230378:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529384.230475:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529384.230507:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108894976 00000100:00100000:3.0:1782529384.230512:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108894976 00010000:00010000:3.0:1782529384.230536:0:14238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 13 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529384.230556:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108895104 00000100:00100000:3.0:1782529384.230558:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108895104 00010000:00010000:3.0:1782529384.230569:0:14238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 14 pid: 14244 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529384.230586:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1782529384.230593:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:923e5c48-29dc-4396-9e3f-0290facfca89+14:2344:x1869117108894976:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529384.230619:0:14238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529384.230625:0:14238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 14 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230649:0:14238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 14 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230665:0:14238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529384.230705:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:923e5c48-29dc-4396-9e3f-0290facfca89+14:2344:x1869117108894976:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 113us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529384.230712:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1782529384.230724:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:3.0:1782529384.230730:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:923e5c48-29dc-4396-9e3f-0290facfca89+13:2343:x1869117108895104:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529384.230739:0:14238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529384.230743:0:14238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 13 pid: 14244 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230751:0:14238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 13 pid: 14244 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230820:0:14238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230829:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230868:0:14238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230875:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230882:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230894:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230900:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:3.0:1782529384.230905:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230912:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.230921:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529384.231052:0:14238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529384.231074:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:923e5c48-29dc-4396-9e3f-0290facfca89+13:2343:x1869117108895104:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 343us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529384.231081:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00010000:00010000:2.0:1782529384.232131:0:16269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c67a1a9800/0x72bfdc08f7eacf2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae20c expref: 12 pid: 14245 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529384.232148:0:16269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273216:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529384.232294:0:16269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d00000/0x72bfdc08f7eacef7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1aa expref: 11 pid: 14244 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529384.232304:0:16269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16269:1869117117273344:192.168.202.50@tcp:104: 00010000:00010000:0.0:1782529384.232333:0:16269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.232342:0:16269:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.232348:0:16269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529384.232355:0:16269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99c647d01400/0x72bfdc08f7eacf59 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529385.100260:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782529385.545213:0:14248:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782529385.545220:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c65f4cf800 from 10 10000000:01000000:0.0:1782529385.545226:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782529385.545273:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c67a1a9000/0x72bfdc08f7eacf60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.545285:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c67a1a9000/0x72bfdc08f7eacf60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.545298:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c67a1a9000/0x72bfdc08f7eacf60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529385.545324:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.545407:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529385.545452:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642bef780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529385.545474:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117274240 00000100:00100000:0.0:1782529385.545481:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117274240 00000100:00100000:0.0:1782529385.545531:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782529385.545540:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+16:14248:x1869117117274240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529385.545552:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529385.545565:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c67a1a8200/0x72bfdc08f7eacf67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacf60 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.545599:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c67a1a8200/0x72bfdc08f7eacf67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacf60 expref: 17 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.545609:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c67a1a8200/0x72bfdc08f7eacf67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacf60 expref: 17 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.545618:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a8200, rc 0) 00000100:00100000:0.0:1782529385.545655:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:14248:x1869117117274240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529385.545662:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782529385.545714:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529385.545728:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c67a1a9000/0x72bfdc08f7eacf60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf67 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.545736:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c67a1a9000/0x72bfdc08f7eacf60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacf67 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529385.545786:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.545818:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529385.545850:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642bef780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529385.545865:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117274368 00000100:00100000:0.0:1782529385.545868:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117274368 00000100:00100000:0.0:1782529385.545891:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782529385.545896:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:14248:x1869117117274368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.548621:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:14248:x1869117117274368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2713us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529385.548635:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782529385.548708:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.548764:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.548810:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529385.548863:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642bef780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529385.548881:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117274496 00000100:00100000:0.0:1782529385.548888:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117274496 00000100:00100000:0.0:1782529385.552124:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782529385.552143:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:14248:x1869117117274496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.552409:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:14248:x1869117117274496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (3598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529385.552419:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782529385.555298:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782529385.560672:0:16333:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782529385.560874:0:14248:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782529385.560896:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782529385.560907:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c67a1a9000/0x72bfdc08f7eacf60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf67 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.560946:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c67a1a9000/0x72bfdc08f7eacf60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf67 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782529385.560958:0:14248:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782529385.560960:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c645ab2000 from 10 10000000:01000000:0.0:1782529385.560963:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782529385.560999:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c67a1a8000/0x72bfdc08f7eacf6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.561008:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c67a1a8000/0x72bfdc08f7eacf6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.561224:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c67a1a8000/0x72bfdc08f7eacf6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529385.561251:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.561316:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529385.561359:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642bef780 going to sleep for 11 seconds 00000100:00100000:3.0:1782529385.562111:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117274624 00000100:00100000:3.0:1782529385.562119:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117274624 00000100:00100000:3.0:1782529385.562165:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782529385.562174:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+17:14248:x1869117117274624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782529385.562189:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529385.562203:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c682044600/0x72bfdc08f7eacf75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacf6e expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529385.562227:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c682044600/0x72bfdc08f7eacf75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacf6e expref: 18 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529385.562237:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c682044600/0x72bfdc08f7eacf75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacf6e expref: 18 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529385.562250:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044600, rc 0) 00000100:00100000:3.0:1782529385.562301:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:14248:x1869117117274624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529385.562308:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782529385.567133:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529385.567165:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c67a1a8000/0x72bfdc08f7eacf6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf75 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529385.567178:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c67a1a8000/0x72bfdc08f7eacf6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacf75 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529385.567403:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.567475:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529385.567535:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642bef780 going to sleep for 11 seconds 00000100:00100000:1.0:1782529385.568077:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117274752 00000100:00100000:1.0:1782529385.568085:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117274752 00000100:00100000:1.0:1782529385.568130:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782529385.568140:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:14248:x1869117117274752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529385.568417:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:14248:x1869117117274752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529385.568426:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782529385.569387:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.569445:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.569503:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529385.569539:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642bef780 going to sleep for 11 seconds 00000100:00100000:3.0:1782529385.569600:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117274880 00000100:00100000:3.0:1782529385.569606:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117274880 00000100:00100000:3.0:1782529385.569651:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782529385.569660:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:14248:x1869117117274880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782529385.569858:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:14248:x1869117117274880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529385.569866:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782529385.569913:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117274880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782529385.573561:0:16335:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782529385.574048:0:14248:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782529385.574072:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782529385.574084:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c67a1a8000/0x72bfdc08f7eacf6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf75 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529385.574096:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c67a1a8000/0x72bfdc08f7eacf6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf75 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782529385.574117:0:14248:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782529385.574119:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff99c67f8f1800 from 10 10000000:01000000:1.0:1782529385.574121:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782529385.574156:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c670570200/0x72bfdc08f7eacf7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529385.574163:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99c670570200/0x72bfdc08f7eacf7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529385.574173:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99c670570200/0x72bfdc08f7eacf7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529385.575029:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117275008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782529385.575100:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529385.575144:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6603dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529385.575166:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117275008 00000100:00100000:1.0:1782529385.575172:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117275008 00000100:00100000:1.0:1782529385.575466:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782529385.575477:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+18:14248:x1869117117275008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529385.575491:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529385.575505:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c670571c00/0x72bfdc08f7eacf83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bfdc08f7eacf7c expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529385.575530:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c670571c00/0x72bfdc08f7eacf83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bfdc08f7eacf7c expref: 19 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529385.575540:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c670571c00/0x72bfdc08f7eacf83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bfdc08f7eacf7c expref: 19 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529385.575561:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c670571c00, rc 0) 00000100:00100000:1.0:1782529385.575613:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:14248:x1869117117275008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529385.575620:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782529385.575663:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117275008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529385.575678:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99c670570200/0x72bfdc08f7eacf7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf83 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529385.575686:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99c670570200/0x72bfdc08f7eacf7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bfdc08f7eacf83 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529385.575741:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117275136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529385.575769:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529385.575783:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6603dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1782529385.575796:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117275136 00000100:00100000:1.0:1782529385.575799:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117275136 00000100:00100000:1.0:1782529385.575821:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782529385.575827:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c65051a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:14248:x1869117117275136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529385.578458:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c65051a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:14248:x1869117117275136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2621us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529385.578471:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782529385.579066:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67831aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117275136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.579125:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117275264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529385.579176:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529385.579225:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642bef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529385.580053:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117275264 00000100:00100000:1.0:1782529385.580062:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117275264 00000100:00100000:1.0:1782529385.580110:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782529385.580119:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c650519050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:14248:x1869117117275264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529385.580328:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c650519050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:14248:x1869117117275264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529385.580336:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782529385.580393:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dec586b-6fd4-4acc-b993-13a64cbeab0a:14248:1869117117275264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782529385.581076:0:16336:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782529385.581138:0:14248:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782529385.581160:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782529385.581170:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99c670570200/0x72bfdc08f7eacf7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf83 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529385.581181:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99c670570200/0x72bfdc08f7eacf7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bfdc08f7eacf83 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529386.119665:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529386.140943:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529386.141053:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108895232 00000100:00100000:0.0:1782529386.141065:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108895232 00000100:00100000:0.0:1782529386.141126:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 113 00000100:00100000:0.0:1782529386.141138:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+11:13743:x1869117108895232:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782529386.141158:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529386.141177:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c67a1a8400/0x72bfdc08f7eacf8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae23d expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529386.141220:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c67a1a8400/0x72bfdc08f7eacf8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae23d expref: 12 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529386.141233:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c67a1a8400/0x72bfdc08f7eacf8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae23d expref: 12 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529386.141244:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a8400, rc 0) 00000100:00100000:0.0:1782529386.141303:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+12:13743:x1869117108895232:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 167us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529386.141318:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 113 00000100:00100000:3.0:1782529386.144108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529386.144210:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108895360 00000100:00100000:0.0:1782529386.144220:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108895360 00000100:00100000:0.0:1782529386.144272:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:0.0:1782529386.144281:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+12:13743:x1869117108895360:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782529386.144558:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+12:13743:x1869117108895360:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 277us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529386.144566:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:0.0:1782529386.149812:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529386.149923:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108895488 00000100:00100000:1.0:1782529386.149933:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108895488 00000100:00100000:1.0:1782529386.149989:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:1.0:1782529386.149999:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+12:13743:x1869117108895488:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782529386.150235:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+12:13743:x1869117108895488:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 237us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529386.150243:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:0.0:1782529386.171645:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529386.172941:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108895616 00000100:00100000:1.0:1782529386.172955:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108895616 00000100:00100000:1.0:1782529386.173018:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:1.0:1782529386.173029:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+12:13743:x1869117108895616:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782529386.173046:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529386.173078:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99c670571400/0x72bfdc08f7eacf91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae244 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529386.173109:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99c670571400/0x72bfdc08f7eacf91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae244 expref: 13 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529386.173121:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99c670571400/0x72bfdc08f7eacf91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae244 expref: 13 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529386.173131:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c670571400, rc 0) 00000100:00100000:1.0:1782529386.173202:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:923e5c48-29dc-4396-9e3f-0290facfca89+13:13743:x1869117108895616:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529386.173209:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:0.0:1782529386.178740:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529386.178820:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108895744 00000100:00100000:1.0:1782529386.178830:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108895744 00000100:00100000:1.0:1782529386.178911:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:1.0:1782529386.178922:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+13:13743:x1869117108895744:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782529386.179240:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+13:13743:x1869117108895744:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 319us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529386.179248:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:3.0:1782529386.186649:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529386.186748:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108895872 00000100:00100000:0.0:1782529386.186759:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108895872 00000100:00100000:0.0:1782529386.186821:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:0.0:1782529386.186871:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:13743:x1869117108895872:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782529386.187125:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:13743:x1869117108895872:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 294us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529386.187134:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 118 00010000:00010000:2.0:1782529387.143215:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782529387.591421:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117275776:0@lo:400:kworker.0 00000100:00100000:0.0:1782529387.591491:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117275520:0@lo:400:kworker.0 00000100:00100000:2.0:1782529387.591505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529387.591619:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117275776 00000100:00100000:1.0:1782529387.591628:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117275776 00000100:00100000:1.0:1782529387.591683:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782529387.591693:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117275776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529387.591784:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117275392:0@lo:400:kworker.0 00000100:00100000:0.0:1782529387.600710:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529387.600764:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117275776:12345-0@lo:400:kworker.0 Request processed in 9069us (9255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529387.600778:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782529387.600987:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117275648:0@lo:400:kworker.0 00000100:00100000:2.0:1782529387.601695:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117275776:0@lo:400:kworker.0 00000100:00100000:2.0:1782529387.601721:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117276288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529387.601751:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782529387.601880:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117276288 00000100:00100000:1.0:1782529387.601889:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117276288 00000100:00100000:1.0:1782529387.602328:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782529387.602338:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117276288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782529387.602380:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782529387.602430:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117276288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529387.602436:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1782529387.602508:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529387.602541:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c678319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117276288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529387.602659:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529387.602732:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117275904:0@lo:400:kworker.0 00000100:00100000:3.0:1782529387.602769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529387.602867:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117275904 00000100:00100000:2.0:1782529387.602872:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117275904 00000100:00080000:3.0:1782529387.603254:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529387.603318:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782529387.603326:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117275904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529387.603375:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1869117117275904:12345-0@lo:400:kworker.0 Request processed in 50us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529387.603381:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782529387.603489:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117275392 00000100:00100000:1.0:1782529387.603494:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117275392 00000100:00100000:1.0:1782529387.603524:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782529387.603529:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3297:x1869117117275392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529387.603592:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117275520 00000100:00100000:2.0:1782529387.603596:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117275520 00000100:00100000:2.0:1782529387.603625:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782529387.603630:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117275520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529387.603681:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1869117117275904:0@lo:400:kworker.0 00000100:00100000:2.0:1782529387.614500:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869117117275520:12345-0@lo:400:kworker.0 Request processed in 10859us (13790us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529387.614516:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782529387.615708:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1869117117275520:0@lo:400:kworker.0 00000100:00100000:0.0:1782529387.615727:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117276032:0@lo:400:kworker.0 00000100:00100000:0.0:1782529387.615787:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529387.615912:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529387.615934:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117276160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782529387.615962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529387.616015:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117276160 00000100:00100000:0.0:1782529387.616022:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117276160 00000100:00100000:0.0:1782529387.616077:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782529387.616087:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117276160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782529387.616323:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782529387.616370:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117276160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529387.616378:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1782529387.616402:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529387.616434:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117276160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782529387.616617:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117276032 00000100:00100000:2.0:1782529387.616622:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117276032 00000100:00100000:2.0:1782529387.616673:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782529387.616681:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117276032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529387.616727:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869117117276032:12345-0@lo:400:kworker.0 Request processed in 47us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529387.616733:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782529387.616830:0:14886:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117275648 00000100:00100000:3.0:1782529387.616865:0:14886:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117275648 00000100:00100000:3.0:1782529387.616893:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782529387.616899:0:14886:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117275648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529387.616956:0:14886:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117275648:12345-0@lo:400:kworker.0 Request processed in 57us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529387.616963:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1782529387.619155:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529387.619345:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117275648:0@lo:400:kworker.0 00000100:00100000:0.0:1782529387.619401:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1869117117276032:0@lo:400:kworker.0 00000100:00100000:1.0:1782529387.621333:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3297:x1869117117275392:12345-0@lo:400:kworker.0 Request processed in 17793us (18664us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529387.621347:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782529387.621498:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3297:1869117117275392:0@lo:400:kworker.0 00000100:00100000:3.0:1782529387.854891:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529387.854936:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529387.854971:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529387.855006:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529387.855309:0:14244:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108896000 00000100:00100000:0.0:1782529387.855321:0:14244:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108896000 00000100:00100000:0.0:1782529387.855380:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:0.0:1782529387.855390:0:14244:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+13:2341:x1869117108896000:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529387.855462:0:14244:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:923e5c48-29dc-4396-9e3f-0290facfca89+13:2341:x1869117108896000:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 74us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529387.855469:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:0.0:1782529387.855509:0:15665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108896256 00000100:00100000:0.0:1782529387.855513:0:15665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108896256 00000100:00100000:0.0:1782529387.855546:0:15665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108896768 00000100:00100000:0.0:1782529387.855563:0:15665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108896768 00000100:00100000:0.0:1782529387.855603:0:15665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:0.0:1782529387.855610:0:15665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b437120-96ff-49ee-9e7b-527157856ce3+5:2341:x1869117108896256:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529387.855641:0:15665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b437120-96ff-49ee-9e7b-527157856ce3+5:2341:x1869117108896256:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 32us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529387.855648:0:15665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:0.0:1782529387.855662:0:15665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:0.0:1782529387.855668:0:15665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2341:x1869117108896768:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529387.855692:0:15665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2341:x1869117108896768:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529387.855696:0:15665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00080000:0.0:1782529387.855715:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782529387.855719:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529387.856268:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108896512 00000100:00100000:2.0:1782529387.856274:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108896512 00000100:00100000:2.0:1782529387.856329:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:2.0:1782529387.856337:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2341:x1869117108896512:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529387.856373:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2341:x1869117108896512:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 37us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529387.856379:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00080000:0.0:1782529387.859764:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529387.867223:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529387.867345:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529387.867390:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529387.867499:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108896384 00000100:00100000:2.0:1782529387.867508:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108896384 00000100:00100000:2.0:1782529387.867562:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108896640 00000100:00100000:2.0:1782529387.867576:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108896640 00000100:00100000:2.0:1782529387.867603:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:2.0:1782529387.867613:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b437120-96ff-49ee-9e7b-527157856ce3+5:2342:x1869117108896384:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529387.867689:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b437120-96ff-49ee-9e7b-527157856ce3+5:2342:x1869117108896384:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 77us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529387.867696:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:2.0:1782529387.867713:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1782529387.867719:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2342:x1869117108896640:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529387.867743:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2342:x1869117108896640:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529387.867749:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00080000:0.0:1782529387.868058:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782529387.868063:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782529387.868131:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108896128 00000100:00100000:1.0:1782529387.868137:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108896128 00000100:00100000:1.0:1782529387.868198:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:1.0:1782529387.868207:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+6:2342:x1869117108896128:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1782529387.868250:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+6:2342:x1869117108896128:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 44us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529387.868256:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00080000:0.0:1782529387.868371:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529388.166346:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.167087:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108896896 00000100:00100000:0.0:1782529388.167099:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108896896 00000100:00100000:0.0:1782529388.167162:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:0.0:1782529388.167172:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+6:14400:x1869117108896896:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529388.167195:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529388.167214:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8800/0x72bfdc08f7eacf98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae24b expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167283:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167316:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167339:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167355:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167361:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167368:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167867:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9600/0x72bfdc08f7eacfad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167879:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9600/0x72bfdc08f7eacfad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.167886:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9600/0x72bfdc08f7eacfad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529388.167974:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782529388.167978:0:15471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529388.168076:0:15471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9600/0x72bfdc08f7eacfad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168088:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168106:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168112:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168118:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529388.168122:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168129:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168142:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c659557000) 00010000:00010000:0.0:1782529388.168146:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529388.168151:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168158:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7eacf9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168171:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168177:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168182:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168187:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529388.168196:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168203:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168212:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99c644d76400) 00010000:00010000:0.0:1782529388.168214:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529388.168218:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168224:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfa6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168258:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8800/0x72bfdc08f7eacf98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae24b expref: 8 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168271:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9600/0x72bfdc08f7eacfad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae24b expref: 7 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.168278:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99c644d76c00) 00010000:00010000:0.0:1782529388.168280:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782529388.168282:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9600, rc 0) 00000100:00100000:0.0:1782529388.168359:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+7:14400:x1869117108896896:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1187us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529388.168368:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00010000:00010000:2.0:1782529388.168638:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782529388.172830:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529388.173334:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108897152 00000100:00100000:1.0:1782529388.173348:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108897152 00000100:00100000:1.0:1782529388.173431:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:1.0:1782529388.173444:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+7:14400:x1869117108897152:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782529388.173490:0:14253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529388.173518:0:14253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570400/0x72bfdc08f7eacfb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae252 expref: -99 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.173643:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.173660:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.173674:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.173690:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.173697:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.173703:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.178031:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570800/0x72bfdc08f7eacfc9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.178064:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570800/0x72bfdc08f7eacfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.178080:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570800/0x72bfdc08f7eacfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529388.178099:0:14253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1782529388.180365:0:14253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180388:0:14253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180395:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180404:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529388.180410:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180419:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180441:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99c644d76c00) 00010000:00010000:1.0:1782529388.180444:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529388.180450:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180456:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180474:0:14253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180480:0:14253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180485:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180510:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529388.180513:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180518:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180526:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99c659557900) 00010000:00010000:1.0:1782529388.180529:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529388.180532:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.180537:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfc2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.183445:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570400/0x72bfdc08f7eacfb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae252 expref: 10 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.183479:0:14253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570800/0x72bfdc08f7eacfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae252 expref: 9 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.183489:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c659557600) 00010000:00010000:1.0:1782529388.183492:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529388.183495:0:14253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c670570800, rc 0) 00000100:00100000:1.0:1782529388.183671:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+9:14400:x1869117108897152:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 10227us (10864us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782529388.183683:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:1.0:1782529388.188205:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.189112:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108897280 00000100:00100000:2.0:1782529388.189131:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108897280 00000100:00100000:2.0:1782529388.189267:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1782529388.189279:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+9:14400:x1869117108897280:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782529388.189446:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+9:14400:x1869117108897280:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 168us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529388.189456:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1782529388.244923:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529388.245130:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108897408 00000100:00100000:1.0:1782529388.245145:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108897408 00000100:00100000:1.0:1782529388.245239:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:1.0:1782529388.245251:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+9:14406:x1869117108897408:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529388.245285:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529388.245315:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570400/0x72bfdc08f7eacfd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae259 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.245406:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.245425:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.245439:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.245454:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.245461:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.245468:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.245808:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.245818:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246174:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246181:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529388.246186:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246194:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246208:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c659557000) 00010000:00010000:1.0:1782529388.246211:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529388.246217:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246222:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571e00/0x72bfdc08f7eacfde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246235:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246241:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246247:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246251:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529388.246254:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246270:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246279:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99c659557900) 00010000:00010000:1.0:1782529388.246282:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529388.246285:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246291:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670571a00/0x72bfdc08f7eacfe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246335:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570400/0x72bfdc08f7eacfd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae259 expref: 10 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246345:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c659557000) 00010000:00010000:1.0:1782529388.246348:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529388.246351:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570400/0x72bfdc08f7eacfd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae259 expref: 10 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.246362:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c670570400, rc 0) 00000100:00100000:1.0:1782529388.246451:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+9:14406:x1869117108897408:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1201us (1543us total) trans 0 rc 301/301 00000100:00100000:1.0:1782529388.246459:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:1.0:1782529388.256189:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.256377:0:14260:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108897536 00000100:00100000:2.0:1782529388.256391:0:14260:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108897536 00000100:00100000:2.0:1782529388.256466:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1782529388.256477:0:14260:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4b437120-96ff-49ee-9e7b-527157856ce3+9:14406:x1869117108897536:12345-192.168.202.50@tcp:700:lfs.0 00000100:00100000:2.0:1782529388.256656:0:14260:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4b437120-96ff-49ee-9e7b-527157856ce3+9:14406:x1869117108897536:12345-192.168.202.50@tcp:700:lfs.0 Request processed in 180us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529388.256665:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1782529388.260755:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.261093:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108897792 00000100:00100000:0.0:1782529388.261235:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108897792 00000100:00100000:0.0:1782529388.261324:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1782529388.261338:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+9:14406:x1869117108897792:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:0.0:1782529388.261438:0:15471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529388.261475:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570000/0x72bfdc08f7eacf1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae1d4 expref: 9 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.261500:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c659557000) 00010000:00010000:0.0:1782529388.261506:0:15471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782529388.262529:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.262552:0:15471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 5 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.262578:0:15471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.262636:0:15471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 5 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.262656:0:15471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 5 pid: 14252 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529388.262675:0:15471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1869117117276416:192.168.202.50@tcp:104: 00000100:00100000:0.0:1782529388.262825:0:15471:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c642bef780 going to sleep for 11 seconds 00000100:00100000:0.0:1782529388.267154:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.267392:0:15471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1869117117276416:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529388.267428:0:15471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529388.267639:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108897920 00000100:00100000:3.0:1782529388.267649:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108897920 00010000:00010000:3.0:1782529388.267700:0:14238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 6 pid: 14252 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529388.267746:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:3.0:1782529388.267757:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2344:x1869117108897920:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529388.267778:0:14238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529388.267786:0:14238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 6 pid: 14252 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.267800:0:14238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 6 pid: 14252 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.268270:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7eacf52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae236 expref: 6 pid: 14252 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.268291:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c659557000) 00010000:00010000:3.0:1782529388.268311:0:14238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.268322:0:14238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.268330:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.268361:0:14238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529388.268435:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2344:x1869117108897920:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 679us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529388.268445:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00010000:00010000:2.0:1782529388.269401:0:15471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.269416:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.269457:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.269472:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.269484:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529388.273749:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782529388.273777:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.273801:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.273809:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.273815:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529388.273821:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.273830:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.274449:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c659557000) 00010000:00010000:2.0:1782529388.274453:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529388.274460:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.274466:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7eacfec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529388.274497:0:15471:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000644eb056 reply state 0000000040ead4c0 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529388.274510:0:15471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782529388.274737:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+10:14406:x1869117108897792:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 13395us (13990us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782529388.274749:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00010000:00010000:2.0:1782529388.287496:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.287532:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.287540:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.287547:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529388.287554:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.287574:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.287597:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99c669568000) 00010000:00010000:2.0:1782529388.288013:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529388.288023:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.288030:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacff3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529388.369790:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.370051:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108898048 00000100:00100000:2.0:1782529388.370064:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108898048 00000100:00100000:2.0:1782529388.370145:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:2.0:1782529388.370156:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+9:14414:x1869117108898048:12345-192.168.202.50@tcp:101:lctl.0 00010000:00010000:2.0:1782529388.370197:0:14253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529388.370227:0:14253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae260 expref: -99 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.370340:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7ead001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.370356:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7ead001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.370370:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7ead001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529388.370462:0:14253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782529388.370467:0:14253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529388.370520:0:14253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7ead001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.370550:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7eacffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae260 expref: 11 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.370702:0:14253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01400/0x72bfdc08f7ead001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae260 expref: 10 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.370716:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568000) 00010000:00010000:2.0:1782529388.370719:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529388.370725:0:14253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01400, rc 0) 00000100:00100000:2.0:1782529388.371043:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+10:14414:x1869117108898048:12345-192.168.202.50@tcp:101:lctl.0 Request processed in 887us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529388.371052:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1782529388.399808:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.400009:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108898176 00000100:00100000:2.0:1782529388.400023:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108898176 00000100:00100000:2.0:1782529388.400132:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:2.0:1782529388.400144:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:14415:x1869117108898176:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529388.400181:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529388.400210:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae267 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.400305:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7ead00f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.400323:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7ead00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.400336:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7ead00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529388.400414:0:14252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782529388.400418:0:14252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529388.400443:0:14252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7ead00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.400469:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae267 expref: 7 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.400489:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01800/0x72bfdc08f7ead00f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae267 expref: 6 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.400498:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568000) 00010000:00010000:2.0:1782529388.400501:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529388.400505:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01800, rc 0) 00000100:00100000:2.0:1782529388.400591:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:14415:x1869117108898176:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 449us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529388.401529:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:3.0:1782529388.406632:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.407240:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108898304 00000100:00100000:2.0:1782529388.407255:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108898304 00000100:00100000:2.0:1782529388.407344:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1782529388.407355:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:14415:x1869117108898304:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529388.407385:0:14253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529388.407419:0:14253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae26e expref: -99 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.407509:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.407526:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.407540:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.407557:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.407574:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.407580:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408643:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead02b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408690:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408705:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529388.408782:0:14253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782529388.408786:0:14253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529388.408812:0:14253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408824:0:14253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408830:0:14253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408877:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408885:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529388.408888:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408896:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408907:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568000) 00010000:00010000:2.0:1782529388.408910:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529388.408914:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408930:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead01d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408945:0:14253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408950:0:14253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408955:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408959:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529388.408961:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408967:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408973:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99c669568c00) 00010000:00010000:2.0:1782529388.408975:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529388.408978:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.408982:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead024 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.409020:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae26e expref: 8 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.409042:0:14253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead02b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae26e expref: 7 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.409048:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529388.409050:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529388.409052:0:14253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01600, rc 0) 00000100:00100000:2.0:1782529388.409144:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+7:14415:x1869117108898304:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1789us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529388.409152:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:1.0:1782529388.417665:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.417819:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108898560 00000100:00100000:0.0:1782529388.417861:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108898560 00000100:00100000:0.0:1782529388.417937:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1782529388.417961:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+7:14415:x1869117108898560:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529388.417981:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529388.418003:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae275 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529388.418111:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782529388.418242:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead032 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae275 expref: 9 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.418257:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568000) 00010000:00010000:0.0:1782529388.418261:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529388.418266:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae275 expref: 9 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.418282:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9200, rc 0) 00000100:00100000:0.0:1782529388.418362:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+8:14415:x1869117108898560:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 402us (711us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1782529388.418369:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1782529388.421386:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.421540:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108898816 00000100:00100000:2.0:1782529388.421550:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108898816 00000100:00100000:2.0:1782529388.421627:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:2.0:1782529388.421636:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+8:14415:x1869117108898816:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:2.0:1782529388.421691:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529388.421717:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead02b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae26e expref: 8 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.421736:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529388.421746:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529388.421769:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.421780:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.421790:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782529388.424554:0:14253:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093d39461 reply state 00000000e878abb9 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529388.424593:0:14253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782529388.424736:0:14253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1782529388.425056:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+9:14415:x1869117108898816:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 3414us (3674us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1782529388.425066:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:1.0:1782529388.433942:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.434021:0:14254:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108899072 00000100:00100000:2.0:1782529388.434035:0:14254:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108899072 00000100:00100000:2.0:1782529388.434112:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:2.0:1782529388.434122:0:14254:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+9:14415:x1869117108899072:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1782529388.434545:0:14254:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+10:14415:x1869117108899072:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 422us (615us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1782529388.434554:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00010000:00010000:3.0:1782529388.434763:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.434780:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.434789:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.434797:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529388.434820:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.434830:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.434883:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99c669568c00) 00010000:00010000:3.0:1782529388.434888:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782529388.434894:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.434901:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead040 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529388.439770:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.440228:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108899328 00000100:00100000:0.0:1782529388.440243:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108899328 00000100:00100000:0.0:1782529388.440317:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:0.0:1782529388.440329:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67831b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+9:14415:x1869117108899328:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529388.440363:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529388.440393:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead047 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae27c expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.440515:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.440532:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.440545:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.440572:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.440580:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.440586:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529388.440766:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782529388.441328:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441339:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441347:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441355:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529388.441360:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441383:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441400:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568000) 00010000:00010000:0.0:1782529388.441404:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529388.441411:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441418:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead04e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441434:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441439:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441445:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441451:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529388.441454:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441460:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441468:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99c644d76400) 00010000:00010000:0.0:1782529388.441470:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529388.441473:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441489:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead055 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441547:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead047 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae27c expref: 11 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441558:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568000) 00010000:00010000:0.0:1782529388.441572:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529388.441576:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead047 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae27c expref: 11 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.441585:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9200, rc 0) 00000100:00100000:0.0:1782529388.441689:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67831b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+10:14415:x1869117108899328:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1361us (1933us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1782529388.441698:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:1.0:1782529388.445629:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.445741:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108899456 00000100:00100000:2.0:1782529388.445754:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108899456 00000100:00100000:2.0:1782529388.445828:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:2.0:1782529388.445890:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+10:14415:x1869117108899456:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1782529388.445922:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529388.445954:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead063 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae283 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.446089:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.446108:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.446137:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529388.446219:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782529388.446223:0:14251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529388.446250:0:14251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.446299:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead063 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 12 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.446321:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 11 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.446330:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529388.446333:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782529388.446337:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00800, rc 0) 00000100:00100000:2.0:1782529388.446413:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+11:14415:x1869117108899456:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 527us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529388.446421:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:2.0:1782529388.460890:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529388.461773:0:14254:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108899584 00000100:00100000:3.0:1782529388.461791:0:14254:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108899584 00000100:00100000:3.0:1782529388.461918:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1782529388.461933:0:14254:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+11:14415:x1869117108899584:12345-192.168.202.50@tcp:37:lfs.0 00000100:00100000:2.0:1782529388.480540:0:14254:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+11:14415:x1869117108899584:12345-192.168.202.50@tcp:37:lfs.0 Request processed in 18592us (19648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529388.480558:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1782529388.485621:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.485742:0:14255:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108899840 00000100:00100000:2.0:1782529388.485754:0:14255:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108899840 00000100:00100000:2.0:1782529388.485826:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1782529388.486053:0:14255:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c65f5a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+11:14415:x1869117108899840:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1782529388.486643:0:14255:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c65f5a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+12:14415:x1869117108899840:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 804us (1032us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1782529388.486655:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000040:00080000:3.0:1782529388.487814:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782529388.546353:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.547011:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108899968 00000100:00100000:2.0:1782529388.547026:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108899968 00000100:00100000:2.0:1782529388.547146:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:2.0:1782529388.547158:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+10:14421:x1869117108899968:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1782529388.547187:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529388.547221:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae28a expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.547440:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.547460:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.547474:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.547493:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.547500:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.547507:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.548931:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead086 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.548951:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.548964:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529388.549010:0:14252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782529388.549014:0:14252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529388.549068:0:14252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549102:0:14252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549109:0:14252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549116:0:14252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549133:0:14252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529388.549140:0:14252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549149:0:14252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549166:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568000) 00010000:00010000:0.0:1782529388.549170:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529388.549176:0:14252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549182:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead078 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549199:0:14252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549206:0:14252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549212:0:14252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549223:0:14252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529388.549227:0:14252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549234:0:14252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549242:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99c669568700) 00010000:00010000:0.0:1782529388.549245:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529388.549248:0:14252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549253:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead07f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549313:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae28a expref: 12 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549328:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8e00/0x72bfdc08f7ead086 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae28a expref: 11 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.549336:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99c669568200) 00010000:00010000:0.0:1782529388.549339:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782529388.549341:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a8e00, rc 0) 00000100:00100000:0.0:1782529388.549440:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+11:14421:x1869117108899968:12345-192.168.202.50@tcp:101:bash.0 Request processed in 2283us (3102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529388.549450:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:1.0:1782529388.557233:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529388.558897:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108900224 00000100:00100000:3.0:1782529388.558921:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108900224 00000100:00100000:3.0:1782529388.559021:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:3.0:1782529388.559034:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c678319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+11:14421:x1869117108900224:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1782529388.559066:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529388.559095:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead08d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae291 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.559308:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.559354:0:14251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 11 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.559366:0:14251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.559416:0:14251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 11 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.559431:0:14251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 11 pid: 14251 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529388.559449:0:14251:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f198000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14251:1869117117276544:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529388.559591:0:14251:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645352540 going to sleep for 11 seconds 00000100:00100000:1.0:1782529388.572064:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529388.572302:0:14251:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f198000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14251:1869117117276544:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529388.572338:0:14251:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529388.576524:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108900352 00000100:00100000:2.0:1782529388.576541:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108900352 00010000:00010000:0.0:1782529388.576794:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 12 pid: 14251 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529388.576891:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:0.0:1782529388.576900:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+12:2344:x1869117108900352:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529388.576918:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529388.576925:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 12 pid: 14251 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.576937:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 12 pid: 14251 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.576958:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead06a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae283 expref: 12 pid: 14251 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.576974:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99c669568200) 00010000:00010000:0.0:1782529388.576978:0:14236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.576987:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.576994:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.577025:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529388.577085:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+11:2344:x1869117108900352:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 186us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529388.577093:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00010000:00010000:3.0:1782529388.578392:0:14251:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.578415:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.578456:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.578472:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529388.578503:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580155:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580175:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580275:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529388.580288:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782529388.580317:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580325:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580332:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580338:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529388.580342:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580349:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580362:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529388.580364:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529388.580369:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580375:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044000/0x72bfdc08f7ead094 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782529388.580388:0:14251:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db033238 reply state 000000009ab0516f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529388.580407:0:14251:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782529388.580447:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead08d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 14 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580462:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 13 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.580469:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:2.0:1782529388.580471:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1782529388.580473:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00600, rc 0) 00000100:00100000:2.0:1782529388.580551:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c678319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+14:14421:x1869117108900224:12345-192.168.202.50@tcp:101:bash.0 Request processed in 21520us (23331us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1782529388.580570:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00010000:00010000:2.0:1782529388.582342:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.582354:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.582358:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.582362:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529388.582365:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.582370:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.582394:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99c6601f9700) 00010000:00010000:2.0:1782529388.582396:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529388.582399:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529388.582403:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead09b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529388.608611:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.610804:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108900480 00000100:00100000:0.0:1782529388.610868:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108900480 00000100:00100000:0.0:1782529388.610940:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:0.0:1782529388.610950:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+13:14421:x1869117108900480:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1782529388.610981:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529388.611006:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8c00/0x72bfdc08f7ead0b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae298 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.611084:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.611099:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.611112:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529388.611155:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782529388.611160:0:15471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529388.611179:0:15471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.611190:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.611213:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8c00/0x72bfdc08f7ead0b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 15 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.611233:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 14 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.611243:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529388.611252:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529388.611256:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9400, rc 0) 00000100:00100000:0.0:1782529388.611333:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+14:14421:x1869117108900480:12345-192.168.202.50@tcp:101:bash.0 Request processed in 384us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529388.611340:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:1.0:1782529388.618944:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.619026:0:14254:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108900736 00000100:00100000:0.0:1782529388.619044:0:14254:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108900736 00000100:00100000:0.0:1782529388.619116:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1782529388.619127:0:14254:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b437120-96ff-49ee-9e7b-527157856ce3+14:14421:x1869117108900736:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:0.0:1782529388.619502:0:14254:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b437120-96ff-49ee-9e7b-527157856ce3+15:14421:x1869117108900736:12345-192.168.202.50@tcp:35:bash.0 Request processed in 375us (583us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1782529388.619511:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:2.0:1782529388.799210:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529388.799344:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108900992 00000100:00100000:1.0:1782529388.799358:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108900992 00000100:00100000:1.0:1782529388.799440:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:1.0:1782529388.799452:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+15:14431:x1869117108900992:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1782529388.799486:0:14253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529388.799514:0:14253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead0be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae29f expref: -99 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782529388.799700:0:14253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782529388.799889:0:14253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead0be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae29f expref: 17 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.799906:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99c669568000) 00010000:00010000:1.0:1782529388.799909:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782529388.799915:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead0be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae29f expref: 17 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.799932:0:14253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c670570c00, rc 0) 00000100:00100000:1.0:1782529388.800021:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+16:14431:x1869117108900992:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 570us (827us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1782529388.800029:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:1.0:1782529388.811258:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.811362:0:14254:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108901248 00000100:00100000:0.0:1782529388.811376:0:14254:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108901248 00000100:00100000:0.0:1782529388.811446:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:0.0:1782529388.811456:0:14254:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b437120-96ff-49ee-9e7b-527157856ce3+16:14431:x1869117108901248:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1782529388.812033:0:14254:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b437120-96ff-49ee-9e7b-527157856ce3+17:14431:x1869117108901248:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 575us (788us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1782529388.812042:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:3.0:1782529388.906328:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.906520:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108901504 00000100:00100000:0.0:1782529388.906596:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108901504 00000100:00100000:0.0:1782529388.906680:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1782529388.906692:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+17:14434:x1869117108901504:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1782529388.906730:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529388.906826:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8c00/0x72bfdc08f7ead0cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2a6 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.907258:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead0d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.907497:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.907513:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529388.907901:0:14252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782529388.910861:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8c00/0x72bfdc08f7ead0cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2a6 expref: 20 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.910907:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2a6 expref: 19 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.910921:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529388.910924:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782529388.910930:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9200, rc 0) 00000100:00100000:0.0:1782529388.911060:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+19:14434:x1869117108901504:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 4368us (4746us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1782529388.911072:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:2.0:1782529388.920568:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529388.922596:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529388.922723:0:14237:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108901760 00000100:00100000:0.0:1782529388.922737:0:14237:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108901760 00000100:00100000:0.0:1782529388.922822:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:0.0:1782529388.922883:0:14237:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b437120-96ff-49ee-9e7b-527157856ce3+19:2343:x1869117108901760:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529388.922904:0:14237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529388.922955:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead0d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2a6 expref: 19 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529388.922980:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529388.922987:0:14237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529388.923057:0:14237:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b437120-96ff-49ee-9e7b-527157856ce3+18:2343:x1869117108901760:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 225us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529388.923068:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:1.0:1782529388.923688:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108901632 00000100:00100000:1.0:1782529388.923708:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108901632 00000100:00100000:1.0:1782529388.923767:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1782529388.923775:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+18:14434:x1869117108901632:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1782529388.923895:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.923914:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.923928:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.924139:0:14253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.924148:0:14253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.924155:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.924162:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670570600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529388.924175:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.924184:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.924196:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:1.0:1782529388.924199:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782529388.924204:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529388.924221:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529388.924476:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+18:14434:x1869117108901632:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 700us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529388.924485:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:3.0:1782529388.927972:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529388.928088:0:14255:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108902016 00000100:00100000:2.0:1782529388.928109:0:14255:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108902016 00000100:00100000:2.0:1782529388.928518:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1782529388.928531:0:14255:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b437120-96ff-49ee-9e7b-527157856ce3+18:14434:x1869117108902016:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1782529388.928923:0:14255:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b437120-96ff-49ee-9e7b-527157856ce3+19:14434:x1869117108902016:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 393us (965us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1782529388.928933:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00010000:00010000:2.0:1782529389.191250:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782529389.425087:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529389.425506:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108902272 00000100:00100000:2.0:1782529389.425519:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108902272 00000100:00080000:0.0:1782529389.425588:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782529389.425623:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1782529389.425636:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+19:14465:x1869117108902272:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:2.0:1782529389.425668:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529389.425696:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead0e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2ad expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529389.425901:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead0ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529389.425920:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead0ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529389.425935:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead0ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529389.425947:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782529389.426098:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead0e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ad expref: 22 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529389.426118:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead0ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ad expref: 21 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529389.426126:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:2.0:1782529389.426129:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529389.426132:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d00800, rc 0) 00000100:00100000:2.0:1782529389.426906:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+21:14465:x1869117108902272:12345-192.168.202.50@tcp:101:cat.0 Request processed in 1269us (1828us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1782529389.426917:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:3.0:1782529389.442121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529389.442728:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108902400 00000100:00100000:0.0:1782529389.442747:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108902400 00000100:00100000:0.0:1782529389.442923:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:0.0:1782529389.442947:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b437120-96ff-49ee-9e7b-527157856ce3+21:2343:x1869117108902400:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529389.442968:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529389.443005:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead0ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ad expref: 21 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.443029:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529389.443035:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529389.443115:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b437120-96ff-49ee-9e7b-527157856ce3+20:2343:x1869117108902400:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 180us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529389.443123:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:3.0:1782529389.449381:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529389.449533:0:14254:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108902656 00000100:00100000:1.0:1782529389.449562:0:14254:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108902656 00000100:00100000:1.0:1782529389.449646:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:1.0:1782529389.449658:0:14254:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b437120-96ff-49ee-9e7b-527157856ce3+20:14465:x1869117108902656:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:1.0:1782529389.450072:0:14254:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b437120-96ff-49ee-9e7b-527157856ce3+21:14465:x1869117108902656:12345-192.168.202.50@tcp:35:cat.0 Request processed in 416us (703us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1782529389.450081:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:2.0:1782529389.531255:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529389.533064:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108902912 00000100:00100000:1.0:1782529389.533081:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108902912 00000100:00100000:1.0:1782529389.533169:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:1.0:1782529389.533179:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+21:14471:x1869117108902912:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:1.0:1782529389.533207:0:14253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782529389.533229:0:14253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0fd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2b4 expref: -99 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529389.533345:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529389.533359:0:14253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 22 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529389.533384:0:14253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 22 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529389.533392:0:14253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529389.533427:0:14253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 22 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529389.533441:0:14253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 22 pid: 15471 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529389.533455:0:14253:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14253:1869117117276672:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529389.533579:0:14253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 22 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529389.533589:0:14253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 22 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529389.533598:0:14253:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67b0c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14253:1869117117276800:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529389.533622:0:14253:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c67830bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782529389.541586:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529389.541636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529389.542116:0:14253:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14253:1869117117276672:192.168.202.50@tcp:104: 00000100:00100000:1.0:1782529389.542134:0:14253:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67b0c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14253:1869117117276800:192.168.202.50@tcp:104: 00010000:00010000:1.0:1782529389.542162:0:14253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529389.543744:0:14237:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108903040 00000100:00100000:0.0:1782529389.543764:0:14237:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108903040 00010000:00010000:0.0:1782529389.543830:0:14237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 23 pid: 15471 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529389.544213:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108903168 00000100:00100000:1.0:1782529389.544230:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108903168 00000100:00100000:0.0:1782529389.544387:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1782529389.544401:0:14237:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c644e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b437120-96ff-49ee-9e7b-527157856ce3+24:2344:x1869117108903040:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529389.544424:0:14237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529389.544432:0:14237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 24 pid: 15471 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.544447:0:14237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 24 pid: 15471 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.544475:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead0b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae298 expref: 24 pid: 15471 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.544496:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529389.544503:0:14237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.544513:0:14237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.544520:0:14237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529389.544617:0:14237:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c644e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b437120-96ff-49ee-9e7b-527157856ce3+23:2344:x1869117108903040:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 219us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529389.544625:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00010000:00010000:1.0:1782529389.545156:0:14238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 22 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529389.545280:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:0.0:1782529389.545293:0:14237:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b437120-96ff-49ee-9e7b-527157856ce3+22:2344:x1869117108903168:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782529389.545318:0:14237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529389.545325:0:14237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 22 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.545338:0:14237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 22 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.545356:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00600/0x72bfdc08f7ead0a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae291 expref: 22 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.545370:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529389.545375:0:14237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.545385:0:14237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.545392:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.545421:0:14237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782529389.545454:0:14237:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b437120-96ff-49ee-9e7b-527157856ce3+21:2344:x1869117108903168:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 163us (3816us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529389.545462:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00010000:00010000:0.0:1782529389.558346:0:14253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.558366:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529389.558413:0:14253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782529389.558625:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570600/0x72bfdc08f7ead0fd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2b4 expref: 22 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.558647:0:14253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570a00/0x72bfdc08f7ead104 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2b4 expref: 21 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.558657:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529389.558660:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782529389.558664:0:14253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c670570a00, rc 0) 00000100:00100000:0.0:1782529389.558729:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+21:14471:x1869117108902912:12345-192.168.202.50@tcp:101:dd.0 Request processed in 25550us (27491us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1782529389.558739:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:3.0:1782529389.567367:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529389.567562:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108903424 00000100:00100000:0.0:1782529389.567582:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108903424 00000100:00100000:0.0:1782529389.567670:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:0.0:1782529389.567692:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+21:14471:x1869117108903424:12345-192.168.202.50@tcp:36:dd.0 00010000:00010000:0.0:1782529389.568057:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.568074:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.568087:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782529389.568143:0:14252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1782529389.568200:0:14252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000929d67cf reply state 000000003695746a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529389.568210:0:14252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782529389.568312:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+24:14471:x1869117108903424:12345-192.168.202.50@tcp:36:dd.0 Request processed in 622us (960us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1782529389.568319:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00000020:00080000:0.0:1782529389.568324:0:14252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782529389.571313:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529389.571337:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529389.571346:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529389.571353:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529389.571360:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529389.571368:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529389.571393:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:3.0:1782529389.571397:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782529389.571421:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529389.571429:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9200/0x72bfdc08f7ead112 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529389.575306:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529389.575391:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108903552 00000100:00100000:0.0:1782529389.575408:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108903552 00000100:00100000:0.0:1782529389.575506:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:0.0:1782529389.575517:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+23:14471:x1869117108903552:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1782529389.575543:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529389.575575:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7ead119 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2bb expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.575634:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7ead119 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2bb expref: 24 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.575650:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7ead119 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2bb expref: 24 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.575675:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529389.575678:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529389.575683:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9800, rc 0) 00000100:00100000:0.0:1782529389.575757:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+24:14471:x1869117108903552:12345-192.168.202.50@tcp:101:dd.0 Request processed in 241us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529389.575764:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:2.0:1782529389.591952:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529389.592039:0:16271:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108903808 00000100:00100000:1.0:1782529389.592049:0:16271:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108903808 00000100:00100000:1.0:1782529389.592102:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:1.0:1782529389.592111:0:16271:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b437120-96ff-49ee-9e7b-527157856ce3+24:14471:x1869117108903808:12345-192.168.202.50@tcp:103:dd.0 00010000:00010000:1.0:1782529389.592127:0:16271:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782529389.592153:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9800/0x72bfdc08f7ead119 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2bb expref: 24 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529389.592172:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:1.0:1782529389.592177:0:16271:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782529389.592231:0:16271:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b437120-96ff-49ee-9e7b-527157856ce3+23:14471:x1869117108903808:12345-192.168.202.50@tcp:103:dd.0 Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529389.592239:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1782529389.595056:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529389.595158:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108903936 00000100:00100000:2.0:1782529389.595174:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108903936 00000100:00100000:2.0:1782529389.595257:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:2.0:1782529389.595268:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+23:14471:x1869117108903936:12345-192.168.202.50@tcp:58:dd.0 00010000:00010000:2.0:1782529389.595398:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529389.595417:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529389.595436:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782529389.600701:0:15471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782529389.602125:0:15471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1782529389.602220:0:15471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1782529389.603459:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+23:14471:x1869117108903936:12345-192.168.202.50@tcp:58:dd.0 Request processed in 8184us (8409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529389.603472:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:3.0:1782529389.609966:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529389.610099:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108904064 00000100:00100000:0.0:1782529389.610112:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108904064 00000100:00100000:0.0:1782529389.610204:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:0.0:1782529389.610219:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+23:14471:x1869117108904064:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1782529389.610251:0:14253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529389.610281:0:14253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead127 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2c2 expref: -99 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.610362:0:14253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.610374:0:14253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead127 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c2 expref: 24 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.610397:0:14253:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.610416:0:14253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead127 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c2 expref: 24 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.610432:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529389.610435:0:14253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782529389.610439:0:14253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead127 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c2 expref: 24 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529389.610447:0:14253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a9400, rc 0) 00000100:00100000:0.0:1782529389.610535:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+24:14471:x1869117108904064:12345-192.168.202.50@tcp:101:dd.0 Request processed in 310us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529389.610544:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00010000:00010000:1.0:1782529390.215798:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782529390.271460:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:2.0:1782529390.271499:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1782529390.271559:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:3.0:1782529390.539224:0:14285:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782529390.539236:0:14285:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782529390.539271:0:14285:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782529390.539278:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1782529390.539407:0:14285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f198e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14285:1869117117276928:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782529390.539518:0:14285:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6453529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782529390.543030:0:14285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f198e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14285:1869117117276928:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782529390.562827:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.572414:0:14262:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108904192 00000100:00100000:2.0:1782529390.572432:0:14262:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108904192 00000100:00100000:2.0:1782529390.572501:0:14262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1782529390.572511:0:14262:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4b437120-96ff-49ee-9e7b-527157856ce3+11:14473:x1869117108904192:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1782529390.572633:0:14262:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c643966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4b437120-96ff-49ee-9e7b-527157856ce3+11:14473:x1869117108904192:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 Request processed in 123us (9814us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.572640:0:14262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1782529390.576196:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.576376:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108904320 00000100:00100000:0.0:1782529390.576387:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108904320 00000100:00100000:0.0:1782529390.576455:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:0.0:1782529390.576466:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+11:14473:x1869117108904320:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782529390.576502:0:14252:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782529390.576634:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+11:14473:x1869117108904320:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 169us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529390.576641:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:3.0:1782529390.582158:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.583221:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108904448 00000100:00100000:2.0:1782529390.583235:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108904448 00000100:00100000:2.0:1782529390.583307:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:2.0:1782529390.583317:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+11:14473:x1869117108904448:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782529390.583396:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583434:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583446:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583463:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583471:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583478:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583505:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583526:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583534:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782529390.583583:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782529390.583587:0:14251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782529390.583603:0:14251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583615:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583630:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583637:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583643:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529390.583648:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583656:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583668:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c659557600) 00010000:00010000:2.0:1782529390.583671:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529390.583675:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583682:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead12e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583710:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583716:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583721:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583726:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529390.583735:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583742:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583750:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99c669568b00) 00010000:00010000:2.0:1782529390.583752:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529390.583755:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583760:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead135 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583776:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583781:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583787:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583792:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529390.583794:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583799:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583807:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:2.0:1782529390.583809:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529390.583818:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.583824:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead13c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.584659:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+11:14473:x1869117108904448:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 1339us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.584669:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:1.0:1782529390.588322:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.588418:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108904704 00000100:00100000:0.0:1782529390.588430:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108904704 00000100:00100000:0.0:1782529390.588495:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:0.0:1782529390.588506:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+11:14473:x1869117108904704:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529390.588610:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529390.588633:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7ead143 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2c9 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.589045:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.589063:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.589075:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529390.589675:0:14252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782529390.590428:0:14252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.590458:0:14252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.590467:0:14252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.590473:0:14252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8600 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529390.590478:0:14252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.590486:0:14252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.590502:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:0.0:1782529390.590505:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782529390.590510:0:14252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.593220:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead14a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.593298:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7ead143 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c9 expref: 13 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.593313:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99c659557600) 00010000:00010000:0.0:1782529390.593317:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782529390.593323:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8a00/0x72bfdc08f7ead143 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c9 expref: 13 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.593334:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a8a00, rc 0) 00000100:00100000:0.0:1782529390.593440:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+12:14473:x1869117108904704:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 4934us (5128us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1782529390.593449:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:1.0:1782529390.606614:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.607398:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108904832 00000100:00100000:2.0:1782529390.607409:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108904832 00000100:00100000:2.0:1782529390.607471:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1782529390.607481:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+12:14473:x1869117108904832:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782529390.607535:0:14251:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782529390.607645:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+12:14473:x1869117108904832:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 165us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.607653:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1782529390.617798:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529390.618132:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108905088 00000100:00100000:3.0:1782529390.618142:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108905088 00000100:00100000:3.0:1782529390.618204:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:3.0:1782529390.618213:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+12:14473:x1869117108905088:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529390.618239:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529390.618259:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead158 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2d0 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782529390.621804:0:15471:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1782529390.621818:0:15471:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1782529390.622352:0:15471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1782529390.623484:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead15f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.623505:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead15f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.624069:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead15f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.624560:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead158 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2d0 expref: 15 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.624584:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead15f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2d0 expref: 14 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.624594:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c6601f9400) 00010000:00010000:2.0:1782529390.624597:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782529390.624601:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044400, rc 0) 00000100:00100000:2.0:1782529390.624687:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+14:14473:x1869117108905088:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 6472us (6897us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1782529390.624720:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:1.0:1782529390.639332:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.639438:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108905344 00000100:00100000:2.0:1782529390.639448:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108905344 00000100:00100000:2.0:1782529390.639511:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:2.0:1782529390.639532:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+14:14473:x1869117108905344:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782529390.639635:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529390.639664:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead15f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2d0 expref: 14 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.639686:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c6601f9400) 00010000:00010000:2.0:1782529390.639698:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782529390.639721:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.639735:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.639745:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.639759:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.639766:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.639772:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640604:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640617:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640624:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640631:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529390.640635:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640643:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640655:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99c669568200) 00010000:00010000:2.0:1782529390.640657:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529390.640661:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640667:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00800/0x72bfdc08f7ead16d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640677:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640683:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640689:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640700:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529390.640703:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640709:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640717:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x68553bd1 (ffff99c669568b00) 00010000:00010000:2.0:1782529390.640720:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782529390.640722:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.640728:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead174 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x68553bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.640819:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b437120-96ff-49ee-9e7b-527157856ce3+13:14473:x1869117108905344:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 1287us (1495us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782529390.640827:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:1.0:1782529390.647422:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.647533:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108905472 00000100:00100000:0.0:1782529390.647553:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108905472 00000100:00100000:0.0:1782529390.647615:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:0.0:1782529390.647626:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+13:14473:x1869117108905472:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529390.647649:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529390.647672:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead17b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2d7 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.647729:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8800/0x72bfdc08f7ead182 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.647744:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8800/0x72bfdc08f7ead182 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.647756:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8800/0x72bfdc08f7ead182 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.647916:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead17b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2d7 expref: 15 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.647935:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8800/0x72bfdc08f7ead182 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2d7 expref: 14 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.647944:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:0.0:1782529390.647948:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782529390.647958:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a8800, rc 0) 00000100:00100000:0.0:1782529390.648021:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+14:14473:x1869117108905472:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 396us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529390.648030:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:1.0:1782529390.654036:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.654462:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108905728 00000100:00100000:0.0:1782529390.654475:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108905728 00000100:00100000:0.0:1782529390.654568:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:0.0:1782529390.654579:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+14:14473:x1869117108905728:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782529390.654671:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.654688:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.654714:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782529390.655443:0:14253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1782529390.655455:0:14253:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 452567621219ns, next at 453567619240ns, rc = 0 00000004:00010000:0.0:1782529390.657306:0:14253:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8048918 reply state 0000000073470e38 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529390.657325:0:14253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782529390.657453:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+16:14473:x1869117108905728:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 2871us (3421us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1782529390.657462:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00010000:00010000:2.0:1782529390.661381:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.661402:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.661411:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.661418:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9e00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:2.0:1782529390.661423:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.661448:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.661466:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:2.0:1782529390.661469:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782529390.661474:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.661480:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9e00/0x72bfdc08f7ead189 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529390.663573:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.663865:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108905856 00000100:00100000:2.0:1782529390.663876:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108905856 00000100:00100000:2.0:1782529390.663925:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1782529390.663934:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+15:14473:x1869117108905856:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782529390.663958:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529390.663979:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2de expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.664042:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 16 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.664059:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 16 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.664077:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:2.0:1782529390.664081:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782529390.664085:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01a00, rc 0) 00000100:00100000:2.0:1782529390.664164:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+16:14473:x1869117108905856:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 218us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.664171:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1782529390.684896:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.684983:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108905984 00000100:00100000:0.0:1782529390.684993:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108905984 00000100:00100000:0.0:1782529390.685100:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:0.0:1782529390.685113:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b437120-96ff-49ee-9e7b-527157856ce3+5:2344:x1869117108905984:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782529390.685794:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b437120-96ff-49ee-9e7b-527157856ce3+6:2344:x1869117108905984:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 682us (905us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782529390.685802:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:0.0:1782529390.691568:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00080000:2.0:1782529390.691712:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782529390.692412:0:14255:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108906240 00000100:00100000:3.0:1782529390.692438:0:14255:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108906240 00000100:00100000:3.0:1782529390.692508:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:3.0:1782529390.692519:0:14255:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b437120-96ff-49ee-9e7b-527157856ce3+16:14473:x1869117108906240:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782529390.692792:0:14255:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b437120-96ff-49ee-9e7b-527157856ce3+17:14473:x1869117108906240:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 274us (1231us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1782529390.692800:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:0.0:1782529390.700885:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529390.701043:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108906496 00000100:00100000:1.0:1782529390.701357:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108906496 00000100:00100000:1.0:1782529390.701423:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:1.0:1782529390.701435:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+17:14473:x1869117108906496:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782529390.701581:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+17:14473:x1869117108906496:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 147us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1782529390.701589:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:2.0:1782529390.706174:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.706390:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108906624 00000100:00100000:0.0:1782529390.706401:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108906624 00000100:00100000:0.0:1782529390.706467:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:0.0:1782529390.706476:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+17:14473:x1869117108906624:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782529390.706496:0:14252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782529390.706514:0:14252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead197 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2e5 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.706672:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead19e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.706687:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead19e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.706699:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead19e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782529390.706735:0:14252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782529390.706755:0:14252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead19e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.706783:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead197 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2e5 expref: 19 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.706819:0:14252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead19e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2e5 expref: 18 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.706828:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:0.0:1782529390.706886:0:14252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782529390.706890:0:14252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c67a1a8600, rc 0) 00000100:00100000:0.0:1782529390.706947:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+18:14473:x1869117108906624:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 471us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529390.706955:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:0.0:1782529390.713873:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.714031:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108906752 00000100:00100000:2.0:1782529390.714041:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108906752 00000100:00100000:2.0:1782529390.714122:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:2.0:1782529390.714133:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+6:2343:x1869117108906752:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782529390.714380:0:14887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782529390.714405:0:14887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2ec expref: -99 pid: 14887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782529390.714435:0:14887:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3f3d6f, blocks: 0x1 00010000:00010000:2.0:1782529390.714456:0:14887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1782529390.714460:0:14887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529390.714470:0:14887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 7 pid: 14887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.714490:0:14887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 7 pid: 14887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.714504:0:14887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c647d01600, rc 0) 00000100:00100000:2.0:1782529390.714586:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+7:2343:x1869117108906752:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 454us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.714611:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1782529390.720137:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.720325:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108907008 00000100:00100000:0.0:1782529390.720336:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108907008 00000100:00100000:0.0:1782529390.720398:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:0.0:1782529390.720408:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+18:14473:x1869117108907008:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782529390.720525:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+18:14473:x1869117108907008:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 117us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529390.720533:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:3.0:1782529390.724424:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.724535:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108907136 00000100:00100000:0.0:1782529390.724555:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108907136 00000100:00100000:0.0:1782529390.724628:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:0.0:1782529390.724640:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+18:14473:x1869117108907136:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1782529390.761809:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1782529390.761824:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1782529390.761869:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:2.0:1782529390.761997:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+14:14473:x1869117108907136:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 37353us (37578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.762007:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:2.0:1782529390.766064:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117277056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782529390.766146:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529390.766413:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.766487:0:14886:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117277056 00000100:00100000:2.0:1782529390.766494:0:14886:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117277056 00000100:00100000:2.0:1782529390.766564:0:14886:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108907264 00000100:00100000:2.0:1782529390.766568:0:14886:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108907264 00000100:00100000:2.0:1782529390.766591:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782529390.766599:0:14886:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117277056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782529390.766778:0:14886:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782529390.766782:0:14886:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1782529390.766785:0:14886:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782529390.766787:0:14886:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782529391 -> 1782529391 00002000:00010000:2.0:1782529390.766790:0:14886:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782529390.766829:0:14886:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1869117117277056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (682us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1782529390.766869:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782529390.766887:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:2.0:1782529390.766893:0:14886:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b437120-96ff-49ee-9e7b-527157856ce3+7:2343:x1869117108907264:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782529390.766953:0:14886:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b437120-96ff-49ee-9e7b-527157856ce3+7:2343:x1869117108907264:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 59us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.766973:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000004:00080000:2.0:1782529390.767022:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99c67fae5500/2, rc 0, transno 8589934595 00000100:00100000:2.0:1782529390.767028:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67fae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117277056:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1782529390.767627:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529390.771105:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529390.771304:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108907520 00000100:00100000:0.0:1782529390.771315:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108907520 00000100:00100000:0.0:1782529390.771395:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:0.0:1782529390.771406:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+14:14473:x1869117108907520:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782529390.771471:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782529390.771501:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a8600/0x72bfdc08f7ead19e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2e5 expref: 14 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.771523:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:0.0:1782529390.771528:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782529390.771578:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.771597:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.771609:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782529390.771880:0:14253:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063e67a19 reply state 0000000048c22374 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782529390.771891:0:14253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782529390.772023:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b437120-96ff-49ee-9e7b-527157856ce3+15:14473:x1869117108907520:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 616us (930us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1782529390.772031:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00010000:00010000:0.0:1782529390.775878:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.775895:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.775920:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.775927:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a9a00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:0.0:1782529390.775932:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.775940:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.775958:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:0.0:1782529390.775962:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782529390.775966:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529390.775972:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9a00/0x72bfdc08f7ead1ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.778974:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529390.779065:0:14886:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108907648 00000100:00100000:3.0:1782529390.779076:0:14886:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108907648 00000100:00100000:3.0:1782529390.779145:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1782529390.779161:0:14886:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b437120-96ff-49ee-9e7b-527157856ce3+7:14473:x1869117108907648:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782529390.779181:0:14886:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782529390.779202:0:14886:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b25081efa0ae2f3 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.779245:0:14886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 8 pid: 14887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.779254:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529390.779258:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529390.779263:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 8 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.779298:0:14886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 8 pid: 14887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.779312:0:14886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 8 pid: 14887 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529390.779327:0:14886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14886:1869117117277184:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529390.779409:0:14886:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66060a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782529390.782970:0:14886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14886:1869117117277184:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529390.783010:0:14886:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 8 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.783032:0:14886:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99c682044000, rc 0) 00000100:00100000:2.0:1782529390.783114:0:14886:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b437120-96ff-49ee-9e7b-527157856ce3+8:14473:x1869117108907648:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 3959us (4151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.783123:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1782529390.785158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.785735:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108907776 00000100:00100000:2.0:1782529390.785745:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108907776 00010000:00010000:2.0:1782529390.785789:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 8 pid: 14887 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.785872:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:2.0:1782529390.785882:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b437120-96ff-49ee-9e7b-527157856ce3+8:2344:x1869117108907776:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529390.785898:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529390.785920:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 8 pid: 14887 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.785953:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 8 pid: 14887 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.785978:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2ec expref: 8 pid: 14887 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.785994:0:14236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529390.785999:0:14236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529390.786005:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 7 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.786015:0:14236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 7 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.786057:0:14236:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 7 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.786071:0:14236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14236:1869117117277312:192.168.202.50@tcp:105: 00000100:00100000:2.0:1782529390.786269:0:14236:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646ec7900 going to sleep for 11 seconds 00000100:00100000:1.0:1782529390.791884:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.792035:0:14236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14236:1869117117277312:192.168.202.50@tcp:105: 00010000:00010000:2.0:1782529390.792061:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529390.792132:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b437120-96ff-49ee-9e7b-527157856ce3+7:2344:x1869117108907776:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 6250us (6980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.792165:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1782529390.792353:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108907904 00000100:00100000:3.0:1782529390.792360:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108907904 00000100:00100000:3.0:1782529390.792414:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1782529390.792425:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+7:2344:x1869117108907904:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782529390.792639:0:14887:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782529390.792643:0:14887:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782529389 00002000:00010000:3.0:1782529390.792646:0:14887:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782529388 00002000:00010000:3.0:1782529390.792648:0:14887:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782529391 -> 1782529389 00002000:00010000:3.0:1782529390.792656:0:14887:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782529390.792683:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b437120-96ff-49ee-9e7b-527157856ce3+8:2344:x1869117108907904:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 260us (855us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1782529390.792690:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1782529390.796945:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.799639:0:15665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108908032 00000100:00100000:2.0:1782529390.799659:0:15665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108908032 00000100:00100000:2.0:1782529390.799737:0:15665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1782529390.799747:0:15665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b437120-96ff-49ee-9e7b-527157856ce3+8:2342:x1869117108908032:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782529390.799792:0:15665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.799811:0:15665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 8 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.799820:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529390.799823:0:15665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782529390.799827:0:15665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.799880:0:15665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 8 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.799895:0:15665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 8 pid: 14886 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.799911:0:15665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15665:1869117117277440:192.168.202.50@tcp:104: 00000100:00100000:2.0:1782529390.800008:0:15665:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c646ec7900 going to sleep for 11 seconds 00000100:00100000:1.0:1782529390.803963:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529390.804059:0:16271:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108908160 00000100:00100000:3.0:1782529390.804069:0:16271:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108908160 00010000:00010000:3.0:1782529390.804122:0:16271:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 9 pid: 14886 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529390.804164:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1782529390.804174:0:16271:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b437120-96ff-49ee-9e7b-527157856ce3+9:2344:x1869117108908160:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782529390.804189:0:16271:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782529390.804214:0:16271:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 9 pid: 14886 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.804229:0:16271:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 9 pid: 14886 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.804258:0:16271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529390.804264:0:16271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782529390.804270:0:16271:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.804280:0:16271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.804322:0:16271:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782529390.804382:0:16271:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b437120-96ff-49ee-9e7b-527157856ce3+9:2344:x1869117108908160:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 209us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529390.804391:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00010000:00010000:2.0:1782529390.805131:0:15665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a60e0942/0x72bfdc08f7ead1b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2f3 expref: 8 pid: 14886 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.805166:0:15665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c67f9e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15665:1869117117277440:192.168.202.50@tcp:104: 00010000:00010000:2.0:1782529390.805188:0:15665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805198:0:15665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805206:0:15665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805231:0:15665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805240:0:15665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805247:0:15665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805253:0:15665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529390.805256:0:15665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805264:0:15665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805286:0:15665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.805292:0:15665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6e3b9c/0x72bfdc08f7ead1ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.805364:0:15665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b437120-96ff-49ee-9e7b-527157856ce3+7:2342:x1869117108908032:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 5618us (8430us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.805372:0:15665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:1.0:1782529390.809449:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529390.809553:0:15471:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108908416 00000100:00100000:3.0:1782529390.809563:0:15471:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108908416 00000100:00100000:3.0:1782529390.809636:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1782529390.809656:0:15471:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+14:14473:x1869117108908416:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782529390.809763:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.809784:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.809796:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.810089:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.810102:0:15471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 15 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.810110:0:15471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.810147:0:15471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 15 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.810431:0:15471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 15 pid: 14252 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529390.810449:0:15471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1869117117277568:192.168.202.50@tcp:104: 00000100:00100000:3.0:1782529390.810593:0:15471:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66060acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782529390.817443:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529390.817593:0:15471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1869117117277568:192.168.202.50@tcp:104: 00010000:00010000:3.0:1782529390.817635:0:15471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.817744:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108908544 00000100:00100000:2.0:1782529390.817752:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108908544 00010000:00010000:2.0:1782529390.817789:0:14238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 16 pid: 14252 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529390.817894:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:2.0:1782529390.817905:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b437120-96ff-49ee-9e7b-527157856ce3+16:2343:x1869117108908544:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782529390.817921:0:14238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782529390.817928:0:14238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 16 pid: 14252 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.817941:0:14238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 16 pid: 14252 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.817963:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01a00/0x72bfdc08f7ead190 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2de expref: 16 pid: 14252 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.817997:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:2.0:1782529390.818003:0:14238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.818012:0:14238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.818020:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.818048:0:14238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782529390.818119:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b437120-96ff-49ee-9e7b-527157856ce3+15:2343:x1869117108908544:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 215us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.818127:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00010000:00010000:3.0:1782529390.818184:0:15471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.818192:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782529390.818370:0:15471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1782529390.818507:0:15471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1782529390.818565:0:15471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1782529390.818666:0:15471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15471:1869117117277696:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782529390.818779:0:15471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529390.818811:0:15471:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c66060a300 going to sleep for 11 seconds 00000100:00100000:3.0:1782529390.818920:0:14256:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117277696 00000100:00100000:3.0:1782529390.818926:0:14256:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117277696 00000100:00100000:3.0:1782529390.818958:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782529390.818966:0:14256:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15471:x1869117117277696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782529390.819040:0:14256:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15471:x1869117117277696:12345-0@lo:1000:mdt00_003.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529390.819054:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782529390.819103:0:15471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15471:1869117117277696:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1782529390.819769:0:15471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1782529390.819859:0:15471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15471:1869117117277824:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782529390.819908:0:15471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529390.819928:0:15471:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c6461b0780 going to sleep for 11 seconds 00000100:00100000:3.0:1782529390.819945:0:14256:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117277824 00000100:00100000:3.0:1782529390.819949:0:14256:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117277824 00000100:00100000:3.0:1782529390.819974:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782529390.819983:0:14256:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15471:x1869117117277824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782529390.820126:0:14256:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15471:x1869117117277824:12345-0@lo:1000:mdt00_003.0 Request processed in 144us (217us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1782529390.820133:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782529390.820170:0:15471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15471:1869117117277824:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1782529390.820199:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820209:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820216:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820222:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045200 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529390.820227:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820235:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820257:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:3.0:1782529390.820260:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782529390.820265:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820272:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682045200/0x72bfdc08f7ead1c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820303:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820309:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820314:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820320:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00000 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:3.0:1782529390.820322:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820328:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820336:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:3.0:1782529390.820339:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782529390.820345:0:15471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead127 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c2 expref: 18 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820356:0:15471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead127 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c2 expref: 18 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820372:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead127 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c2 expref: 18 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.820399:0:15471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99c67a1a9400/0x72bfdc08f7ead127 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0x1b25081efa0ae2c2 expref: 18 pid: 14253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529390.820412:0:15471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677052d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1869117117277952:192.168.202.50@tcp:105: 00000100:00100000:3.0:1782529390.820466:0:15471:0:(client.c:2701:ptlrpc_set_wait()) set ffff99c645352900 going to sleep for 11 seconds 00000100:00100000:0.0:1782529390.828762:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.828867:0:14255:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108908672 00000100:00100000:2.0:1782529390.828877:0:14255:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108908672 00000100:00100000:2.0:1782529390.828925:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1782529390.828935:0:14255:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c65f5a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b437120-96ff-49ee-9e7b-527157856ce3+19:14471:x1869117108908672:12345-192.168.202.50@tcp:49:dd.0 00000100:00100000:2.0:1782529390.829072:0:14255:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c65f5a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b437120-96ff-49ee-9e7b-527157856ce3+19:14471:x1869117108908672:12345-192.168.202.50@tcp:49:dd.0 Request processed in 139us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529390.829096:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1782529390.831339:0:15471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677052d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1869117117277952:192.168.202.50@tcp:105: 00010000:00010000:1.0:1782529390.831374:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831384:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d00000/0x72bfdc08f7ead120 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831428:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831444:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831457:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831469:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831494:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831502:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831508:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670570c00 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529390.831512:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831521:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831533:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:1.0:1782529390.831536:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782529390.831551:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831557:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c670570c00/0x72bfdc08f7ead1cf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831569:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831575:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831580:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831585:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044400 already unused, calling callback (ffffffffc214f4f0) 00010000:00010000:1.0:1782529390.831595:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831601:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831610:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99c669568a00) 00010000:00010000:1.0:1782529390.831612:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782529390.831615:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529390.831621:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c682044400/0x72bfdc08f7ead1c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529390.831882:0:15471:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b437120-96ff-49ee-9e7b-527157856ce3+18:14473:x1869117108908416:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 22235us (22442us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1782529390.831893:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000020:00080000:1.0:1782529390.831899:0:15471:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782529390.832232:0:14285:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782529390.832237:0:14285:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529390.832264:0:14285:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782529390.832270:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782529390.839118:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529390.839292:0:14255:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108908928 00000100:00100000:2.0:1782529390.839303:0:14255:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108908928 00000100:00100000:2.0:1782529390.839371:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:2.0:1782529390.839382:0:14255:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b437120-96ff-49ee-9e7b-527157856ce3+18:14473:x1869117108908928:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782529390.840159:0:14255:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782529390.840269:0:14255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1782529390.840317:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.840336:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.840349:0:14255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.840358:0:14255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.840364:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.840370:0:14255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529390.840397:0:14255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782529390.840496:0:14255:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b437120-96ff-49ee-9e7b-527157856ce3+20:14473:x1869117108908928:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 1115us (1388us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1782529390.840505:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000020:00080000:2.0:1782529390.840510:0:14255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782529390.840910:0:14240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782529390.840919:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.840938:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:3.0:1782529390.840943:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.840952:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.840968:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99c642b0f600) 00010000:00010000:3.0:1782529390.840971:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782529390.840976:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.840981:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99c647d01600/0x72bfdc08f7ead1d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529390.840994:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529390.841005:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782529390.841007:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529391.052897:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529391.052942:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529391.053223:0:14892:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108909184 00000100:00100000:2.0:1782529391.053234:0:14892:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108909184 00000100:00100000:2.0:1782529391.053298:0:14892:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108909056 00000100:00100000:2.0:1782529391.053302:0:14892:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108909056 00000100:00100000:2.0:1782529391.053339:0:14892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1782529391.053349:0:14892:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b437120-96ff-49ee-9e7b-527157856ce3+8:2342:x1869117108909184:12345-192.168.202.50@tcp:4:dd.0 00002000:00010000:2.0:1782529391.053412:0:14892:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a3f3d6d, atime: 0x6a3f3d6c, ctime: 0x6a3f3d6d, blocks: 0x1 00010000:00010000:2.0:1782529391.053422:0:14892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.053439:0:14892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1782529391.053443:0:14892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529391.053450:0:14892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.053464:0:14892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529391.057735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529391.057816:0:14891:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782529391.057825:0:14891:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1782529391.058273:0:14891:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108909312 00000100:00100000:3.0:1782529391.058282:0:14891:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108909312 00000100:00100000:1.0:1782529391.060732:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1782529391.060776:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529391.061583:0:14891:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782529391.061598:0:14891:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108909440 00000100:00100000:3.0:1782529391.061608:0:14891:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108909440 00000100:00100000:3.0:1782529391.061665:0:14891:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782529391.061670:0:14891:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108909568 00000100:00100000:3.0:1782529391.061673:0:14891:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108909568 00000100:00100000:0.0:1782529391.066986:0:16385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:0.0:1782529391.067006:0:16385:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b437120-96ff-49ee-9e7b-527157856ce3+12:2342:x1869117108909056:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:0.0:1782529391.067049:0:16385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529391.067067:0:16385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529391.067070:0:16385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782529391.067076:0:16385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782529391.067096:0:16385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529391.073386:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529391.073521:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1782529391.073575:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529391.073684:0:14893:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1782529391.073695:0:14893:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1782529391.073716:0:14891:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1782529391.073728:0:14891:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108909696 00000100:00100000:2.0:1782529391.073736:0:14891:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108909696 00000100:00100000:2.0:1782529391.073786:0:14891:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1782529391.073795:0:14891:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108909824 00000100:00100000:2.0:1782529391.073797:0:14891:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108909824 00000100:00100000:2.0:1782529391.073810:0:14891:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1782529391.073814:0:14891:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108909952 00000100:00100000:2.0:1782529391.073816:0:14891:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108909952 00000100:00100000:2.0:1782529391.076395:0:16386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:2.0:1782529391.076587:0:16386:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b437120-96ff-49ee-9e7b-527157856ce3+16:2341:x1869117108909312:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:2.0:1782529391.076631:0:16386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.076654:0:16386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529391.076658:0:16386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529391.076664:0:16386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.076678:0:16386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782529391.206879:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1782529391.206902:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:0.0:1782529391.206909:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1782529391.206917:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1782529391.207300:0:14892:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1782529391.207305:0:14892:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1782529389 -> 1782529391 00002000:00010000:3.0:1782529391.207308:0:14892:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782529389 -> 1782529391 00002000:00010000:3.0:1782529391.207310:0:14892:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1782529391.207326:0:14892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.207339:0:14892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.207348:0:14892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.207355:0:14892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d01a00 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:3.0:1782529391.207359:0:14892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.207367:0:14892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.207401:0:14892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.207408:0:14892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086b6f705/0x72bfdc08f7ead1dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529391.207506:0:14892:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b437120-96ff-49ee-9e7b-527157856ce3+16:2342:x1869117108909184:12345-192.168.202.50@tcp:4:dd.0 Request processed in 154154us (154616us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1782529391.207518:0:14892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1782529391.207564:0:14892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1782529391.207577:0:14892:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b437120-96ff-49ee-9e7b-527157856ce3+15:2342:x1869117108909440:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:3.0:1782529391.207612:0:14892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.207626:0:14892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782529391.207630:0:14892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529391.207636:0:14892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.207649:0:14892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.248203:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782529391.298311:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:1.0:1782529391.298649:0:16385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:1.0:1782529391.298656:0:16385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:1.0:1782529391.298677:0:16385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.298694:0:16385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.298723:0:16385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.298731:0:16385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c67a1a8600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529391.298737:0:16385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.298748:0:16385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.298774:0:16385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.298782:0:16385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000180f126a/0x72bfdc08f7ead1e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529391.298949:0:16385:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b437120-96ff-49ee-9e7b-527157856ce3+17:2342:x1869117108909056:12345-192.168.202.50@tcp:4:dd.0 Request processed in 231942us (245997us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1782529391.298969:0:16385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:1.0:1782529391.299028:0:16385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:1.0:1782529391.299042:0:16385:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b437120-96ff-49ee-9e7b-527157856ce3+16:2342:x1869117108909568:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:1.0:1782529391.299086:0:16385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.299101:0:16385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529391.299113:0:16385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529391.299121:0:16385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.299135:0:16385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782529391.363421:0:14892:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1782529391.363432:0:14892:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:1.0:1782529391.363449:0:14892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.363463:0:14892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.363472:0:14892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.363479:0:14892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682045200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529391.363483:0:14892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.363492:0:14892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.363511:0:14892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.363548:0:14892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae91c0a/0x72bfdc08f7ead1f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364233:0:16386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364257:0:16386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364265:0:16386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364272:0:16386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00800 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:3.0:1782529391.364276:0:16386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364285:0:16386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364297:0:16386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364304:0:16386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000531b1b99/0x72bfdc08f7ead1eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782529391.364378:0:16386:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b437120-96ff-49ee-9e7b-527157856ce3+17:2341:x1869117108909312:12345-192.168.202.50@tcp:4:dd.0 Request processed in 287965us (306648us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1782529391.364388:0:16386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1782529391.364419:0:16386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1782529391.364429:0:16386:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b437120-96ff-49ee-9e7b-527157856ce3+16:2341:x1869117108909696:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:3.0:1782529391.364458:0:16386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364473:0:16386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529391.364477:0:16386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782529391.364483:0:16386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782529391.364493:0:16386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782529391.364628:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000100:00100000:1.0:1782529391.365522:0:14892:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b437120-96ff-49ee-9e7b-527157856ce3+13:2342:x1869117108909440:12345-192.168.202.50@tcp:4:dd.0 Request processed in 157944us (304794us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1782529391.365532:0:14892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1782529391.365567:0:14892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1782529391.365584:0:14892:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b437120-96ff-49ee-9e7b-527157856ce3+12:2341:x1869117108909824:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:1.0:1782529391.365605:0:14892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.365618:0:14892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529391.365621:0:14892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782529391.365628:0:14892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.365639:0:14892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782529391.448491:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1782529391.453012:0:16385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:2.0:1782529391.453022:0:16385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1782529391.453040:0:16385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.453052:0:16385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.453060:0:16385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.453067:0:16385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571600 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529391.453072:0:16385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.453082:0:16385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.453114:0:16385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.453121:0:16385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049a8ddeb/0x72bfdc08f7ead1f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529391.453222:0:16385:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b437120-96ff-49ee-9e7b-527157856ce3+14:2342:x1869117108909568:12345-192.168.202.50@tcp:4:dd.0 Request processed in 154180us (392440us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1782529391.453233:0:16385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1782529391.453268:0:16385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1782529391.453291:0:16385:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b437120-96ff-49ee-9e7b-527157856ce3+13:2341:x1869117108909952:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:2.0:1782529391.453332:0:16385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.453344:0:16385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529391.453348:0:16385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782529391.453354:0:16385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.453365:0:16385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782529391.530088:0:14892:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1782529391.530098:0:14892:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1782529391.530114:0:14892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.530250:0:14892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.530260:0:14892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.530269:0:14892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c670571200 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529391.530274:0:14892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.530284:0:14892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.530382:0:14892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.530392:0:14892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040db96a1/0x72bfdc08f7ead207 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529391.530528:0:14892:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b437120-96ff-49ee-9e7b-527157856ce3+15:2341:x1869117108909824:12345-192.168.202.50@tcp:4:dd.0 Request processed in 164948us (457000us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1782529391.530549:0:14892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000001:00080000:1.0:1782529391.530666:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00010000:00010000:2.0:1782529391.530799:0:16386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.530821:0:16386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.530828:0:16386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.536103:0:16386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c682044400 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:2.0:1782529391.536111:0:16386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.536125:0:16386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.536166:0:16386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782529391.536175:0:16386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a7811a9/0x72bfdc08f7ead200 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782529391.536522:0:16386:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b437120-96ff-49ee-9e7b-527157856ce3+9:2341:x1869117108909696:12345-192.168.202.50@tcp:4:dd.0 Request processed in 172091us (463141us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1782529391.536544:0:16386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00002000:00010000:1.0:1782529391.578785:0:16385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1782529391.578809:0:16385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.578856:0:16385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.578866:0:16385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.578875:0:16385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99c647d00000 already unused, calling callback (ffffffffc1748ce0) 00010000:00010000:1.0:1782529391.578880:0:16385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.578890:0:16385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.578909:0:16385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782529391.578917:0:16385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2705262/0x72bfdc08f7ead20e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782529391.579026:0:16385:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b437120-96ff-49ee-9e7b-527157856ce3+7:2341:x1869117108909952:12345-192.168.202.50@tcp:4:dd.0 Request processed in 125746us (505445us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1782529391.579037:0:16385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000001:00080000:2.0:1782529391.597281:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1782529392.264390:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782529392.715020:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782529392.715043:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c647ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117278080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782529392.715114:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782529392.715508:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117278080 00000100:00100000:3.0:1782529392.715517:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117278080 00000100:00100000:3.0:1782529392.715596:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782529392.715605:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67b0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117278080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782529392.715643:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782529392.715697:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67b0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869117117278080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529392.715703:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782529392.715805:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c647ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1869117117278080:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782529392.715900:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782529392.716411:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3295:1869117117278208:0@lo:400:kworker.0 00000100:00100000:0.0:1782529392.716452:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529392.716486:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117278720:0@lo:400:kworker.0 00000100:00100000:0.0:1782529392.716511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529392.716544:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782529392.716549:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117278592:0@lo:400:kworker.0 00000100:00100000:0.0:1782529392.716569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529392.716590:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117278720 00000100:00100000:0.0:1782529392.716595:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117278720 00000100:00100000:0.0:1782529392.716627:0:14253:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117278592 00000100:00100000:0.0:1782529392.716629:0:14253:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117278592 00000100:00100000:0.0:1782529392.716646:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782529392.716652:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117278720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529392.716689:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869117117278720:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529392.716695:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782529392.716722:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782529392.716728:0:14253:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c647ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117278592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782529392.716754:0:14253:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c647ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869117117278592:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529392.716758:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782529392.716771:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782529392.716792:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1869117117278592:0@lo:400:kworker.0 00000100:00100000:0.0:1782529392.716800:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1869117117278720:0@lo:400:kworker.0 00000100:00100000:2.0:1782529392.716907:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117278336:0@lo:400:kworker.0 00000100:00100000:2.0:1782529392.716942:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529392.716970:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782529392.716977:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117278464:0@lo:400:kworker.0 00000100:00100000:2.0:1782529392.716999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782529392.717027:0:14251:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117278464 00000100:00100000:2.0:1782529392.717030:0:14251:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117278464 00000100:00100000:2.0:1782529392.717048:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529392.717053:0:14251:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117278464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782529392.717098:0:14251:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1869117117278464:12345-0@lo:400:kworker.0 Request processed in 45us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529392.717104:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782529392.717131:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1869117117278464:0@lo:400:kworker.0 00000100:00100000:3.0:1782529392.717445:0:14246:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117278208 00000100:00100000:3.0:1782529392.717450:0:14246:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117278208 00000100:00100000:3.0:1782529392.717486:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782529392.717493:0:14246:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3295:x1869117117278208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529392.717544:0:14246:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dec586b-6fd4-4acc-b993-13a64cbeab0a+19:3295:x1869117117278208:12345-0@lo:400:kworker.0 Request processed in 51us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529392.717550:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782529392.717576:0:14887:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117278336 00000100:00100000:3.0:1782529392.717586:0:14887:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117278336 00000100:00100000:3.0:1782529392.717619:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782529392.717625:0:14887:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117278336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782529392.717657:0:14887:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1869117117278336:12345-0@lo:400:kworker.0 Request processed in 33us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529392.717662:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1782529392.717679:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782529392.717785:0:3296:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1782529392.717790:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99c67fae5500, transno 8589934595 00000004:00080000:2.0:1782529392.717809:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1782529392.717825:0:3296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1869117117278336:0@lo:400:kworker.0 00000100:00100000:2.0:1782529392.717887:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dec586b-6fd4-4acc-b993-13a64cbeab0a:3295:1869117117278208:0@lo:400:kworker.0 00000100:00100000:3.0:1782529392.718898:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782529392.718914:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff99c677a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117278848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782529392.718959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782529392.719046:0:14889:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117117278848 00000100:00100000:0.0:1782529392.719052:0:14889:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117117278848 00000100:00100000:0.0:1782529392.719102:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782529392.719109:0:14889:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117278848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782529392.719135:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1782529392.719566:0:14889:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1869117117278848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 456us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529392.719574:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782529392.721669:0:3297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff99c677a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1869117117278848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782529392.974036:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529392.974100:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1782529392.974133:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529392.974358:0:14886:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108910336 00000100:00100000:3.0:1782529392.974368:0:14886:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108910336 00000100:00100000:3.0:1782529392.974448:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:3.0:1782529392.974459:0:14886:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b437120-96ff-49ee-9e7b-527157856ce3+5:2341:x1869117108910336:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529392.974541:0:14886:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b437120-96ff-49ee-9e7b-527157856ce3+5:2341:x1869117108910336:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 83us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529392.974549:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00080000:1.0:1782529392.974672:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782529392.974737:0:14245:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108910080 00000100:00100000:0.0:1782529392.974743:0:14245:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108910080 00000100:00100000:0.0:1782529392.974783:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:0.0:1782529392.974791:0:14245:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67f219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:2341:x1869117108910080:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1782529392.974820:0:14245:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67f219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:923e5c48-29dc-4396-9e3f-0290facfca89+13:2341:x1869117108910080:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 31us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782529392.974826:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:3.0:1782529392.975712:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529392.975749:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529392.975765:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529392.975786:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1782529392.975806:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108910848 00000100:00100000:3.0:1782529392.975811:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108910848 00000100:00100000:3.0:1782529392.975863:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108910464 00000100:00100000:3.0:1782529392.975866:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108910464 00000100:00100000:3.0:1782529392.975880:0:14888:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108910720 00000100:00100000:3.0:1782529392.975896:0:14888:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108910720 00000100:00100000:3.0:1782529392.975917:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:3.0:1782529392.975924:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2341:x1869117108910848:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529392.975970:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2341:x1869117108910848:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 46us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529392.975977:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:3.0:1782529392.975989:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:3.0:1782529392.975995:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b437120-96ff-49ee-9e7b-527157856ce3+5:2341:x1869117108910464:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529392.976022:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b437120-96ff-49ee-9e7b-527157856ce3+5:2341:x1869117108910464:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529392.976028:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:3.0:1782529392.976039:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:3.0:1782529392.976046:0:14888:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2341:x1869117108910720:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1782529392.976070:0:14888:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+5:2341:x1869117108910720:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782529392.976089:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:2.0:1782529392.976900:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108910592 00000100:00100000:2.0:1782529392.976908:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108910592 00000100:00100000:2.0:1782529392.976954:0:14252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869117108910208 00000100:00100000:2.0:1782529392.976957:0:14252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869117108910208 00000100:00100000:2.0:1782529392.976981:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:2.0:1782529392.976989:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c67fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2341:x1869117108910592:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529392.977035:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c67fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43e2eb6c-65b0-43ba-b88d-6b2b0ec91f2d+6:2341:x1869117108910592:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 47us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529392.977051:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:2.0:1782529392.977066:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:2.0:1782529392.977085:0:14252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff99c677050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+20:2341:x1869117108910208:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1782529392.977114:0:14252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff99c677050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b437120-96ff-49ee-9e7b-527157856ce3+20:2341:x1869117108910208:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 42us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782529392.977121:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00080000:3.0:1782529392.977677:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782529392.977683:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782529392.977686:0:14247:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782529393.287726:0:14239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782529393.520410:0:16425:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:2.0:1782529393.930288:0:14285:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782529393.930298:0:14285:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782529393.930337:0:14285:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782529393.930343:0:14285:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1782529394.311313:0:14240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29546 lines, 29546 kept, 0 dropped, 0 bad.